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Preface 


The first edition of this book, published in 1962, was characterized by having 
chapters on sampled-data and nonlinear control systems. The treatment of the 
analysis and design of control systems was all classical. 

The two major changes in the second edition, published in 1967, were the 
inclusion of the state variable technique and the integration of the discrete-data 
systems with the continuous data system. The chapter on nonlinear systems 
was eliminated in the second edition to the disappointment of some users of 
that text. At the time of the revision the author felt that a comprehensive treat- 
ment on the subject of nonlinear systems could not be made effectively with 
the available space. 

The third edition is still written as an introductory text for a senior course 
on control systems. Although a great deal has happened in the area of modern 
control theory in the past ten years, preparing suitable material for a modern 
course on introductory control systems remains a difficult task. The problem is 
a complicated one because it is difficult to teach the topics concerned with new 
developments in modern control theory at the undergraduate level. The unique 
Situation in control systems has been that many of the practical problems are 
still being solved in the industry by the classical methods. While some of the 
techniques in modern control theory are much more powerful and can solve 
more complex problems, there are often more restrictions when it comes to 
practical applications of the solutions. However, it should be recognized that 
a modern control engineer should have an understanding of the classical as 
well as the modern control methods. The latter will enhance and broaden one’s 
perspective in solving a practical problem. It is the author’s opinion that one 
should strike a balance in the teaching of control systems theory at the beginning 


ix 
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and intermediate levels. Therefore in this current edition, equal emphasis is 
placed on the classical methods and the modern control theory. 

A number of introductory books with titles involving modern control 
theory have been published in recent years. Some authors have attempted to 
unify and integrate the classical control with the modern control, but according 
to the critics and reviews, most have failed. Although such a goal is highly 
desirable, if only from the standpoint of presentation, there does not seem to 
be a good solution. It is possible that the objective may not be achieved until 
new theories and new techniques are developed for this purpose. The fact 
remains that control systems, in some way, may be regarded as a science of 
learning how to solve one problem—control, in many different ways. These 
different ways of solution may be compared and weighed against each other, 
but it may not be possible to unify all the approaches. The approach used in 
this text is to present the classical method and the modern approach indepen- 
dently, and whenever possible, the two approaches are considered as alterna- 
tives, and the advantages and disadvantages of each are weighed. Many 
illustrative examples are carried out by both methods. 

Many existing text books on control systems have been criticized for not 
including adequate practical problems. One reason for this is, perhaps, that 
many text book writers are theorists, who lack the practical background and 
experience necessary to provide real-life examples. Another reason is that the 
difficulty in the control systems area is compounded by the fact that most real- 
life problems are highly complex, and are rarely suitable as illustrative examples 
at the introductory level. Usually, much of the realism is Jost by simplifying 
the problem to fit the nice theorems and design techniques developed in the 
text material. Nevertheless, the majority of the students taking a control system 
course at the senior level do not pursue a graduate career, and they must put 
their knowledge to immediate use in their new employment. It is extremely 
important for these students, as well as those who will continue, to gain an 
actual feel of what a real control system is like. Therefore, the author has 
introduced a number of practical examples in various fields in this text. The 
homework problems also reflect the attempt of this text to provide more real- 
life problems. 

The following features of this new edition are emphasized by comparison 
with the first two editions: 


1. Equal emphasis on classical and modern control theory. 
2. Inclusion of sampled-data and nonlinear systems. 
3. Practical system examples and homework problems. 


The material assembled in this book is an outgrowth of a senior-level 
control system course taught by the author at the University of Illinois at 
Urbana-Champaign for many years. Moreover, this book is written in a style 
adaptable for self-study and reference. 

Chapter | presents the basic concept of control systems. The definition of 
feedback and its effects are covered. Chapter 2 presents mathematical founda- 
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tion and preliminaries. The subjects included are Laplace transform, z-trans- 
form, matrix algebra, and the applications of the transform methods. Transfer 
function and signal flow gtaphs are discussed in Chapter 3. Chapter 4 intro- 
duces the state variable approach to dynamical systems. The concepts and 
definitions of controllability and observability are introduced at the early stage. 
These subjects are later being used for the analysis and design of linear control 
systems. Chapter 5 discusses the mathematical modeling of physical systems. 
Here, the emphasis is on electromechanical systems. Typical transducers and 
control systems used in practice are illustrated. The treatment cannot be 
exhaustive as there are numerous types of devices and control systems. Chapter 
6 gives the time response considerations of control systems. Both the classical 
and the modern approach are used. Some simple design considerations in the 
time domain are pointed out. Chapters 7, 8, and 9 deal with topics on stability, 
root locus, and frequency response of control systems. 

In Chapter 10, the design of control Systems is discussed, and the approach 
is basically classical. Chapter 11 contains some of the optimal control subjects 
which, in the author’s opinion, can be taught at the undergraduate level if time 
permits. The text does contain more material than can be covered in one 
semester. 

One of the difficulties in preparing this book was the weighing of what 
subjects to cover. To keep the book to a reasonable length, some subjects, 
which were in the original draft, had to be left out of the final manuscript. 
These included the treatment of signal flow graphs and time-domain analysis, 
of discrete-data systems, the second method of Liapunov’s stability method, 
describing function analysis, state plane analysis, and a few selected topics on 
implementing optimal control. The author feels that the inclusion of these 
subjects would add materially to the spirit of the text, but at the cost of a 
higher price. 

The author wishes to express his sincere appreciation to Dean W. L. 
Everitt (emeritus), Professors E. C. Jordan, O. L. Gaddy, and E. W. Ernst, 
of the University of Illinois, for their encouragement and interest in the project. 
The author is grateful to Dr. Andrew Sage of the University of Virginia and 
Dr. G. Singh of the University of Illinois for their valuable suggestions. Special 
thanks also goes to Mrs. Jane Carlton who typed a good portion of the manu- 
script and gave her invaluable assistance in proofreading. 


BENJAMIN C. Kuo 
Urbana, Illinois 
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Introduction 


1.1 Control Systems 


In recent years, automatic control systems have assumed an increasingly impor- 
tant role in the development and advancement of modern civilization and tech- 
nology. Domestically, automatic controls in heating and air conditioning systems 
regulate the temperature and the humidity of modern homes for comfortable 
living. Industrially, automatic control systems are found in numerous applica- 
tions, such as quality control of manufactured products, automation, machine 
tool control, modern space technology and weapon systems, computer systems, 
transportation systems, and robotics. Even such problems as inventory control, 
social and economic systems control, and environmental and hydrological sys- 
tems control may be approached from the theory of automatic control. 

The basic control system concept may be described by the simple block 
diagram shown in Fig. 1-1. The objective of the system is to control the variable 
c in a prescribed manner by the actuating signal e through the elements of the 
control system. 

In more common terms, the controlled variable is the output of the system, 
and the actuating signal is the input. As a simple example, in the steering control 
of an automobile, the direction of the two front wheels may be regarded as the 
controlled variable c, the output. The position of the steering wheel is the input, 
the actuating signal e. The controlled process or system in this case is composed 
of the steering mechanisms, including the dynamics of the entire automobile. 
However, if the objective is to control the speed of the automobile, then the 
amount of pressure exerted on the accelerator is the actuating signal, with the 
speed regarded as the controlled variable. 
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Actuating Controlled 
signal e Control variable c 
(Input) system (Output) 
Fig. 1-1. Basic control system. 


There are many situations where several variables are to be controlled simul- 
taneously by a number of inputs. Such systems are referred to as multivariable 
systems. 


Open-Loop Control Systems (Nonteedhback Systems) 


The word automatic implies that there is a certain amount of sophistication 
in the control system. By automatic, it generally means that the system is usually 
capable of adapting to a variety of operating conditions and is able to respond 
to a class of inputs satisfactorily. However, not any type of control system has 
the automatic feature. Usually, the automatic feature is achieved by feeding the 
output variable back and comparing it with the command signal. When a system 
does not have the feedback structure, it is called an open-loop system, which is 
the simplest and most economical type of control system. Unfortunately, open- 
loop control systems lack accuracy and versatility and can be used in none but 
the simplest types of applications. 

Consider, for example, control of the furnace for home heating. Let us 
assume that the furnace is equipped only with a timing device, which controls 
the on and off periods of the furnace. To regulate the temperature to the 
proper level, the human operator must estimate the amount of time required 
for the furnace to stay on and then set the timer accordingly. When the preset 
time is up, the furnace is turned off. However, it is quite likely that the house 
temperature is either above or below the desired value, owing to inaccuracy in 
the estimate. Without further deliberation, it is quite apparent that this type of 
control is inaccurate and unreliable. One reason for the inaccuracy lies in the 
fact that one may not know the exact characteristics of the furnace. The other 
factor is that one has no control over the outdoor temperature, which has a 
definite bearing on the indoor temperature. This also points to an important 
disadvantage of the performance of an open-loop control system, in that the 
system is not capable of adapting to variations in environmental conditions or 
to external disturbances. In the case of the furnace control, perhaps an experi- 
enced person can provide control for a certain desired temperature in the house; 
but if the doors or windows are opened or closed intermittently during the 
operating period, the final temperature inside the house will not be accurately 
regulated by the open-loop control. 

An electric washing machine is another typical example of an open-loop 
system, because the amount of wash time is entirely determined by the judgment 
and estimation of the human operator. A true automatic electric washing 
machine should have the means of checking the cleanliness of the clothes con- 
tinuously and turn itself off when the desired degree of cleanliness is reached. 

Although open-loop control systems are of limited use, they form the basic 
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elements of the closed-loop control systems. In general, the elements of an open- 
loop control system are represented by the block diagram of Fig. 1-2. An input 
signal or command r is applied to the controller, whose output acts as the 
actuating signal e; the actuating signal then actuates the controlled process and 
hopefully will drive the controlled variable c to the desired value. 


Reference Actuating Controlied 
input r signal e Controlled variable c 
Controller 
process (Output) 


Fig. 1-2. Block diagram of an open-loop control system. 


Closed-Loop Control Systems (Feedback Control Systems) 


What is missing in the open-loop control system for more accurate and 
more adaptable control is a link or feedback from the output to the input of the 
system. In order to obtain more accurate control, the controlled signal c(t) must 
be fed back and compared with the reference input, and an actuating signal 
proportional to the difference of the output and the input must be sent through 
the system to correct the error. A system with one or more feedback paths like 
that just described is called a closed-loop system. Human beings are probably 
the most complex and sophisticated feedback control system in existence. A 
human being may be considered to be a control system with many inputs and 
outputs, capable of carrying out highly complex operations. 

To illustrate the human being as a feedback control system, let us consider 
that the objective is to reach for an object on a desk. As one is reaching for the 
object, the brain sends out a signal to the arm to perform the task. The eyes 
serve as a sensing device which feeds back continuously the position of the hand, 
The distance between the hand and the object is the error, which is eventually 
brought to zero as the hand reaches the object. This is a typical example of 
closed-loop control. However, if one is told to reach for the object and then is 
blindfolded, one can only reach toward the object by estimating its exact posi- 
tion. It is quite possible that the object may be missed by a wide margin. With 
the eyes blindfolded, the feedback path is broken, and the human is operating - 
as an open-loop system. The example of the reaching of an object by a human 
being is described by the block diagram shown in Fig. 1-3. 

As another illustrative example of a closed-loop control system, Fig. 1-4 


Error 
Input detector a a Controlled 
command Controller nile, variable 
> (brain) process = 
Reach (arm and hand) Position 
for object — oLnand 


Fig. 1-3. Block diagram of a human being as a closed-loop control system. 
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Amplifier 
(controller) 


Steering C 


Fig. 1-4. Rudder control system. 


shows the block diagram of the rudder control system of a ship. In this case the 
objective of control is the position of the rudder, and the reference input is 
applied through the steering wheel. The error between the relative positions of 
the steering wheel and the rudder is the signal, which actuates the controller 
and the motor. When the rudder is finally aligned with the desired reference 
direction, the output of the error sensor is zero. Let us assume that the steering 
wheel position is given a sudden rotation of R units, as shown by the time signal 
in Fig. 1-5(a). The position of the rudder as a function of time, depending upon 
the characteristics of the system, may typically be one of the responses shown 
in Fig. 1-5(b). Because all physical systems have electrical and mechanical inertia, 
the position of the rudder cannot respond instantaneously to a step input, but 
will, rather, move gradually toward the final desired position. Often, the response 
will oscillate about the final position before settling. It is apparent that for the 
rudder control it is desirable to have a nonoscillatory response. 


8,(t) 


R 


(a) (b) 


Fig. 1-5. (a) Step displacement input of rudder control system. (6) Typical 
output responses. 
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Error 
sensor 


Controlled 
process 


Controller 


Feedback 
elements 


Fig. 1-6. Basic elements of a feedback control system. 


The basic elements and the block diagram of a closed-loop control system 
are shown in Fig. 1-6. In general, the configuration of a feedback control system 
may not be constrained to that of Fig. 1-6. In complex systems there may bea 
multitude of feedback loops and element blocks. 

Figure 1-7(a) illustrates the elements of a tension control system of a windup 
process. The unwind reel may contain a roll of material such as paper or cable 
which is to be sent into a processing unit, such as a cutter ora printer, and then 
collects it by winding it onto another roll. The control system in this case is to 
maintain the tension of the material or web at a certain prescribed tension to 
avoid such problems as tearing, stretching, or creasing. 

To regulate the tension, the web is formed into a half-loop by passing it 
down and around a weighted roller. The roller is attached to a pivot arm, which 
allows free up-and-down motion of the roller. The combination of the roller and 
the pivot arm is called the dancer. 

When the system is in operation, the web normally travels at a constant 
speed. The ideal position of the dancer is horizontal, producing a web tension 
equal to one-half of the total weight W of the dancer roll. The electric brake on 
the unwind reel is to generate a restraining torque to keep the dancer in the 
horizontal position at all times. 

During actual operation, because of external disturbances, uncertainties 
and irregularities of the web material, and the decrease of the effective diameter 
of the unwind reel, the dancer arm will not remain horizontal unless some 
scheme is employed to properly sense the dancer-arm position and control the 
restraining braking torque. 

To obtain the correction of the dancing-arm-position error, an angular 
sensor is used to measure the angular deviation, and a signal in proportion to 
the error is used to control the braking torque through a controller. Figure 
1-7(b) shows a block diagram that illustrates the interconnections between the 
elements of the system. 
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Unwind reel 
(decreasing dia.) Web 
i. processing Windup reel 
ot tas tae i (increasing dia.) 


vara | 


Drive system 
(constant web 


Dancer 


Angle 
Linear Semen sea 
controller 
Reference 
(Current) input 
(a) 
Reference 
input Gaiitelles Electric Unwind Tension 
onto brake process 


Dancer 
arm 


(b) 


Fig. 1-7. (a) Tension control system. (b) Block diagram depicting the 
basic elements and interconnections of a tension contro! system. 


4.2 What Is Feedback and What Are Its Effects ? 


The concept of feedback plays an important role in control systems. We demon- 
strated in Section 1.1 that feedback is a major requirement of a closed-loop 
control system. Without feedback, a control system would not be able to achieve 
the accuracy and reliability that are required in most practical applications. 
However, from a more rigorous standpoint, the definition and the significance 
of feedback are much deeper and more difficult to demonstrate than the few 
examples given in Section 1.1. In reality, the reasons for using feedback carry 
far more meaning than the simple one of comparing the input with the output 
in order to reduce the error. The reduction of system error is merely one of the 
many effects that feedback may bring upon a system. We shall now show that 
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feedback also has effects on such system performance characteristics as stability, 
bandwidth, overall gain, impedance, and sensitivity. 

To understand the effects of feedback on a control system, it is essential that 
we examine this phenomenon with a broad mind. When feedback is deliberately 
introduced for the purpose of control, its existence is easily identified. However, 
there are numerous situations wherein a physical system that we normally rec- 
ognize as an inherently nonfeedback system may turn out to have feedback 
when it is observed in a certain manner. In general we can state that whenever 
a closed sequence of cause-and-effect relation exists among the variables of a 
system, feedback is said to exist. This viewpoint will inevitably admit feedback 
in a large number of systems that ordinarily would be identified as nonfeedback 
systems. However, with the availability of the feedback and control system 
theory, this general definition of feedback enables numerous systems, with or 
without physical feedback, to be studied in a systematic way once the existence 
of feedback in the above-mentioned sense is established. . 

We shall now investigate the effects of feedback on the various aspects of 
system performance. Without the necessary background and mathematical 
foundation of linear system theory, at this point we can only rely on simple 
Static system notation for our discussion. Let us consider the simple feedback 
system configuration shown in Fig. 1-8, where r is the input signal, c the output 
signal, e the error, and b the feedback signal. The parameters G and H may be 
considered as constant gains. By simple algebraic manipulations it-is simple to 
show that the input-output relation of the system is 


c G 
Me Cr cy 


Using this basic relationship of the feedback system structure, we can uncover 
some of the significant effects of feedback. 


Fig. 1-8. Feedback system. 


Effect of Feedback on Overall Gain 


As seen from Eq. (1-1), feedback affects the gain G of a nonfeedback system 
by a factor of 1 + GH. The reference of the feedback in the system of Fig. 1-8 
is negative, since a minus sign is assigned to the feedback signal. The quantity 
GH may itself include a minus sign, so the general effect of feedback is that it 
may increase or decrease the gain. In a practical control system, G and H are 
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functions of frequency, so the magnitude of 1 + GH may be greater than 1 in 
one frequency range but less than 1 in another. Therefore, feedback could 
increase the gain of the system in one frequency range but decrease it in another. 


Effect of Feedback on Stability 


Stability is a notion that describes whether the system will be able to follow 
the input command. In a nonrigorous manner, a system is said to be unstable 
if its output is out of control or increases without bound. 

To investigate the effect of feedback on stability, we can again refer to the 
expression in Eq. (1-1). If GH = —1, the output of the system is infinite for any 
finite input. Therefore, we may state that feedback can cause a system that is 
originally stable to become unstable. Certainly, feedback is a two-edged sword; 
when it is improperly used, it can be harmful. It should be pointed out, however, 
that we are only dealing with the static case here, and, in general GH = —1 is 
not the only condition for instability. 

It can be demonstrated that one of the advantages of incorporating feed- 
back is that it can stabilize an unstable system. Let us assume that the feedback 
system in Fig. 1-8 is unstable because GH = —1. If we introduce another feed- 
back loop through a negative feedback of F, as shown in Fig. 1-9, the input— 
output relation of the overall system is 


c G 


7 TP CGREGF ue) 
It is apparent that although the properties of G and H are such that the 
inner-loop feedback system is unstable, because GH = --1, the overall system 


can be stable by properly selecting the outer-loop feedback gain F. 


Fig. 1-9. Feedback system with two feedback loops. 


Effect of Feedback on Sensitivity 


Sensitivity considerations often play an important role in the design of 
control systems. Since all physical elements have properties that change with 
environment and age, we cannot always consider the parameters of a control 
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system to be completely stationary over the entire operating life of the system. 
For instance, the winding resistance of an electric motor changes as the tem- 
perature of the motor rises during operation. In general, a good control system 
should be very insensitive to these parameter variations while still able to follow 
the command responsively. We shall investigate what effect feedback has on the 
sensitivity to parameter variations. 

Referring to the system in Fig. 1-8, we consider G as a parameter that may 
vary. The sensitivity of the gain of the overall system M to the variation in G is 
defined as 


_ OM/M 

~ “9GIG os) 
where 0M denotes the incremental change in M due to the incremental change 
in G; 9M/M and dG/G denote the percentage change in M and G, respectively. 


The expression of the sensitivity function S¥ can be derived by using Eq. (1-1). 
We have 


So 


«OMG 1 : 
So = 9G M = TLGH (1-4) 


This relation shows that the sensitivity function can be made arbitrarily small 
by increasing GH, provided that the system remains stable. It is apparent that 
in an open-loop system the gain of the system will respond in a one-to-one 
fashion to the variation in G. 

In general, the sensitivity of the system gain of a feedback system to param- 
eter variations depends on where the parameter is located. The reader may 
derive the sensitivity of the system in Fig. 1-8 due to the variation of H. 


Effect of Feedback on External Disturbance or Noise 


All physical control systems are subject to some types of extraneous signals 
or noise during operation. Examples of these signals are thermal noise voltage 
in electronic amplifiers and brush or commutator noise in electric motors. 

The effect of feedback on noise depends greatly on where the noise is intro- 
duced into the system; no general conclusions can be made. However, in many 
situations, feedback can reduce the effect of noise on system performance. 

Let us refer to the system shown in Fig. 1-10, in which r denotes the com- 
mand signal and n is the noise signal. In the absence of feedback, H = 0, the 
output c is 


c= G,G,e + Gn (1-5) 
where e = r, The signal-to-noise ratio of the output is defined as 


output due to signal _ G,G,e _ G, £ 


output due to noise G,n na a) 


To increase the signal-to-noise ratio, evidently we should either increase 
the magnitude of G, or e relative to n. Varying the magnitude of G, would have 
no effect whatsoever on the ratio. 

With the presence of feedback, the system output due to r and n acting 
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Fig. 1-10. Feedback system with a noise signal. 


simultaneously is 

___G,G, G, 4 
TtOGn’  Tee.Gn” ey 

Simply comparing Eq. (1-7) with Eq. (1-5) shows that the noise component in 

the output of Eq. (1-7) is reduced by the factor 1 + G,G-.H, but the signal com- 

ponent is also reduced by the same amount. The signal-to-noise ratio is 


output due to signal  G,G,r/ + G,G,H) __ 

output due to noise =—s-_—s G@,n/(1 + G,G,H) 
and is the same as that without feedback. In this case feedback is shown to have 
no direct effect on the output signal-to-noise ratio of the system in Fig. 1-10. 
However, the application of feedback suggests a possibility of improving the 
signal-to-noise ratio under certain conditions. Let us assume that in the system 
of Fig. 1-10, if the magnitude of G, is increased to G, and that of the input r 
to r’, with all other parameters unchanged, the output due to the input signal 
acting alone is at the same level as that when feedback is absent. In other words, 
we let 


Cc 


G; = (1-8) 


c | = G'G,r' 
n=0 "1+ G(G,H . 
With the increased G,, G,, the output due to noise acting alone becomes 
Gn 
1 + G\G,H 


which is smaller than the output due to n when G, is not increased. The signal- 
to-noise ratio is now 


= G,G,r (1-9) 


¢l-0 = (1-10) 


G,G,r Grou g i 
GinlC + GG,H) — n (l v GG,H) ( 11) 
which is greater than that of the system without feedback by a factor of (1 + 
G',G,H). 
In general, feedback also has effects on such performance characteristics 
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as bandwidth, impedance, transient response, and frequency response. These 
effects will become known as one progresses into the ensuing material of this text. 


1.3 Types of Feedback Control Systems 


Feedback control systems may be classified in a number of ways, depending 
upon the purpose of the classification. For instance, according to the method 
of analysis and design, feedback control systems are classified as linear and non- 
linear, time varying or time invariant. According to the types of signal found in 
the system, reference is often made to continuous-data and discrete-data systems, 
or modulated and unmodulated systems. Also, with reference to the type of 
system components, we often come across descriptions such as electromechanical 
control systems, hydraulic control systems, pneumatic systems, and biological 
control systems. Control systems are often classified according to the main pur- 
pose of the system. A positional control system and a velocity control system 
control the output variables according to the way the names imply. In general, 
there are many other ways of identifying control systems according to some 
special features of the system. It is important that some of these more common 
ways of classifying control systems are known so that proper perspective is 
gained before embarking on the analysis and design of these systems. 


Linear Versus Nonlinear Control! Systems 


This classification is made according to the methods of analysis and design. 
Strictly speaking, linear systems do not exist in practice, since all physical sys- 
tems are nonlinear to some extent. Linear feedback control systems are idealized 
models that are fabricated by the analyst purely for the simplicity of analysis 
and design. When the magnitudes of the signals in a control system are limited 
to a range in which system components exhibit linear characteristics (i.e., the 
principle of superposition applies), the system is essentially linear. But when the 
magnitudes of the signals are extended outside the range of the linear operation, 
depending upon the severity of the nonlinearity, the system should no longer be 
considered linear. For instance, amplifiers used in control systems often exhibit 
saturation effect when their input signals become large; the magnetic field of 
a motor usually has saturation properties. Other common nonlinear effects 
found in control systems are the backlash or dead play between coupled gear 
members, nonlinear characteristics in springs, nonlinear frictional force or tor- 
que between moving members, and so on. Quite often, nonlinear characteristics 
are intentionally introduced in a control system to improve its performance or 
provide more effective control. For instance, to achieve minimum-time control, 
an on-off (bang-bang or relay) type of controller is used. This type of control is 
found in many missile or spacecraft control systems. For instance, in the attitude 
control of missiles and spacecraft, jets are mounted on the sides of the vehicle 
to provide reaction torque for attitude control. These jets are often controlled 
in a full-on or full-off fashion, so a fixed amount of air is applied from a given 
jet for a certain time duration to control the attitude of the space vehicle. 
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For linear systems there exists a wealth of analytical and graphical tech- 
niques for design and analysis purposes. However, nonlinear systems are very 
difficult to treat mathematically, and there are no general methods that may be 
used to solve a wide class of nonlinear systems. 


Time-Invariant Versus Time-Varying Systems 


When the parameters of a control system are stationary with respect to 
time during the operation of the system, we have a time-invariant system. Most 
physical systems contain elements that drift or vary with time to some extent. 
If the variation of parameter is significant during the period of operation, the 
system is termed a time-varying system. For instance, the radius of the unwind 
reel of the tension control system in Fig. 1-7 decreases with time as the material 
is being transferred to the windup reel. Although a time-varying system without 
nonlinearity is still a linear system, its analysis is usually much more complex 
than that of the linear time-invariant systems. 


Continuous-Data Control Systems 


A continuous-data system is one in which the signals at various parts of 
the system are all functions of the continuous time variable t. Among all con- 
tinuous-data control systems, the signals may be further classified as ac or de. 
Unlike the general definitions of ac and dc signals used in electrical engineering, 
ac and dc control systems carry special significances. When one refers to an 
ac control system it usually means that the signals in the system are modulated 
by some kind of modulation scheme. On the other hand, when a de control 
system is referred to, it does not mean that all the signals in the system are of 
the direct-current type; then there would be no control movement. A de control 
system simply implies that the signals are unmodulated, but they are still ac by 
common definition. The schematic diagram of a closed-loop de control system 
is shown in Fig. 1-11. Typical waveforms of the system in response to a step 


d-c 
amplifier 


6 Error 

PD) r detector j= |. ‘x 
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input variable 
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t t 


Fig. 1-11. Schematic diagram of a typical de closed-loop control system. 
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function input are shown in the figure. Typical components of a de control SYS- 
tem are potentiometers, de amplifiers, de motors, and de tachometers. 

The schematic diagram of a typical ac control system is shown in Fig, 1-12. 
In this case the signals in the system are modulated; that is, the information is 
transmitted by an ac carrier signal. Notice that the output controlled variable 
still behaves similar to that of the dc system if the two systems have the same 
control objective. In this case the modulated signals are demodulated by the 
low-pass characteristics of the control motor. Typical components of an ac 
control system are synchros, ac amplifiers, ac motors, gyroscopes, and acceler- 
ometers. 

In practice, not all control systems are strictly of the ac or the dc type. A 
system may incorporate a mixture of ac and dc components, using modulators 
and demodulators to match the signals at various points of the system. 


a-c signal 


amplifier 


e 
Synchro Synchro - 
transmitter transformer 


Error detector 
<p 


Controlled 
variable 


t t 


Fig. 1-12. Schematic diagram of a typical ac closed-loop control system. 


Sampled-Data and Digital Control Systems 


Sampled-data and digital control systems differ from the continuous-data 
systems in that the signals at one or more points of the system are in the form 
of either a pulse train or a digital code. Usually, sampled-data systems refer to 
a more general class of systems whose signals are in the form of pulse data, 
where a digital control system refers to the use of a digital computer or controller 
in the system. In this text the term “discrete-data control system” is used to 
describe both types of systems. 

In general a sampled-data system receives data or information only inter- 
mittently at specific instants of time. For instance, the error signal in a control 
system may be supplied only intermittently in the form of pulses, in which case 
the control system receives no information about the error signal during the 
periods between two consecutive pulses. Figure 1-13 illustrates how a typical 
sampled-data system operates. A continuous input signal r(t) is applied to the 
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Fig. 1-13. Block diagram of a sampled-data control system. 


system. The error signal e(t) is sampled by a sampling device, the sampler, and 
the output of the sampler is a sequence of pulses. The sampling rate of the sam- 
pler may or may not be uniform. There are many advantages of incorporating 
sampling in a control system, one of the most easily understood of these being 
that sampling provides time sharing of an expensive equipment among several 
control channels. 

Because digital computers provide many advantages in size and flexibility, 
computer control has become increasingly popular in recent years. Many air- 
borne systems contain digital controllers that can pack several thousand discrete 
elements in a space no larger than the size of this book. Figure 1-14 shows the 
basic elements of a digital autopilot for a guided missile. 


Digital Attitude 
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converter 
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Fig. 1-14. Digital autopilot system for a guided missile. 
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Mathematical Foundation 


2.1 


Introduction 


The study of control systems relies to a great extent on the use of applied mathe- 
matics. For the study of classical control theory, the prerequisites include such 
subjects as complex variable theory, differential equations, Laplace transform, 
and z-transform. Modern control theory, on the other hand, requires consider- 
ably more intensive mathematical background. In addition to the above-men- 
tioned subjects, modern control theory is based on the foundation of matrix 
theory, set theory, linear algebra, variational calculus, various types of mathe- 
matical programming, and so on. 


2.2 Complex-Variable Concept 


Complex-variable theory plays an important role in the analysis and design of 
control systems. When studying linear continuous-data systems, it is essential 
that one understands the concept of complex variable and functions of a complex 
variable when the transfer function method is used. 


Complex Variable 


A complex variable s is considered to have two components: a real compo- 
nent o, and an imaginary component @. Graphically, the real component is 
Tepresented by an axis in the horizontal direction, and the imaginary component 
is measured along a vertical axis, in the complex s-plane. In other words, 
a complex variable is always defined by a point in a complex plane that has 
ao axis and a jq@ axis. Figure 2-1 illustrates the complex s-plane, in which any 


15 
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Fig. 2-1. Complex s-plane. 


arbitrary point, s = 5,, is defined by the coordinates o == 0, and @ = @, or 
simply s, = 0, + ja. 


Functions of a Complex Variable 


The function G(s) is said to be a function of the complex variable s if for 
every value of s there is a corresponding value (or there are corresponding 
values) of G(s). Since s is defined to have real and imaginary parts, the function 
G(s) is also represented by its real and imaginary parts: that is, 


G(s) = ReG + jImG (2-1) 


where Re G denotes the real part of G(s) and Im G represents the imaginary 
part of G. Thus, the function G(s) can also be represented by the complex G- 
plane whose horizontal axis represents Re G and whose vertical axis measures 
the imaginary component of G(s). If for every value of s (every point in the s- 
plane) there is only one corresponding value for G(s) [one corresponding point 
in the G(s)-plane], G(s) is said to be a single-valued function, and the mapping 
(correspondence) from points in the s-plane onto points in the G(s)-plane is 
described as single valued (Fig. 2-2). However, there are many functions for 
which the mapping from the function plane to the complex-variable plane is 


jImG 
G(s)-plane 


ReG 


Fig, 2-2. Single-valued mapping from the s-plane to the G(s)-plane. 
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not single valued. For instance, given the function 
1 

s(s + 1) 

it is apparent that for each value of s there is only one unique corresponding 


value for G(s). However, the reverse is not true; for instance, the point G(s) 
= oo is mapped onto two points, s = 0 and s = —1, in the s-plane, 


G(s) = (2-2) 


Analytic Function 


A function G(s) of the complex variable s is called an analytic function in 
a region of the s-plane if the function and all its derivatives exist in the region. 
For instance, the function given in Eq. (2-2) is analytic at every point in the s- 
plane except at the points s = 0 and s = —]. At these two points the value 
of the function is infinite. The function G(s) = s + 2 is analytic at every point 
in the finite s-plane. 


Singularities and Poles of a Function 


The singularities of a function are the points in the s-plane at which the func- 
tion or its derivatives does not exist. A pole is the most common type of singu- 
larity and plays a very important role in the studies of the classical control 
theory. 

The definition of a pole can be stated as: If a function G(s) is analytic and 
single valued in the neighborhood of 5, except at s,, it is said to have a pole of 
order r at s = s, if the limit 


lim [(s — s,"G(s)] 


has a finite, nonzero value. In other words, the denominator of G(s) must include 
the factor (s — s,)’, so when s = s,, the function becomes infinite. If r = 1, 
the pole at s = 5, is called a simple pole. As an example, the function 


_ 10(s +. 2) : 
OS) = SF ins a 3p (2-3) 
has a pole of order 2 at s = —3 and simple poles at s = O and s = —1. It can 


also be said that the function is analytic in the s-plane except at these poles. 


Zeros of a Function 


The definition of a zero of a function can be stated as: If the function G(s) 
is analytic at s = s,, it is said to have a zero of order r at s = 5, if the limit 


lim [(s — s,)~"G(s)] (2-4) 


has a finite, nonzero value. Or simply, G(s) has a zero of order r at s = 5, if 1/G(s) 
has an rth-order pole at s = s,. For example, the function in Eq. (2-3) has a simple 
zero ats = —2. 

If the function under consideration is a rational function of s, that is, 
a quotient of two polynomials of s, the total number of poles equals the total 
number of zeros, counting the multiple-order poles and zeros, if the poles and 
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zeros at infinity and at zero are taken into account. The function in Eq. (2-3) has 
four finite poles at s = 0, —1, —3, —3; there is one finite zero at s = —2, but 
there are three zeros at infinity, since 
fim G(s) = lim £9 = (2-5) 
gsken soo 5? 
Therefore, the function has a total of four poles and four zeros in the entire s- 
plane. 


2.3 Laplace Transform?* 


The Laplace transform is one of the mathematical tools used for the solution 
of ordinary linear differential equations. In comparison with the classical method 
of solving linear differential equations, the Laplace transform method has the 
following two attractive features: 


1. The homogeneous equation and the particular integral are solved 
in one operation. 

2. The Laplace transform converts the differential equation into an 
algebraic equation in s. It is then possible to manipulate the algebraic 
equation by simple algebraic rules to obtain the solution in the s 
domain. The final solution is obtained by taking the inverse Laplace 
transform. 


Definition of the Laplace Transform 


Given the function f(t) which satisfies the condition 


J f@er*| at < 0 (2-6) 
0 
for some finite real a, the Laplace transform of f(t) is defined as 

F(s) = i f(De~* dt (2-7) 
or 

F(s) = £[f@) (2-8) 


The variable s is referred to as the Laplace operator, which is a complex 
variable; that is, s = o + j@. The defining equation of Eq. (2-7) is also known 
as the one-sided Laplace transform, as the integration is evaluated from 0 to oo. 
This simply means that all information contained in f(#) prior to t = Ois ignored 
or considered to be zero. This assumption does not place any serious limitation 
on the applications of the Laplace transform to linear system problems, since 
in the usual time-domain studies, time reference is often chosen at the instant 
t = 0. Furthermore, for a physical system when an input is applied at t = 0, 
the response of the system does not start sooner than ¢ = 0; that is, response 
does not precede excitation. 

The following examples serve as illustrations on how Eq. (2-7) may be used 
for the evaluation of the Laplace transform of a function /(¢). 
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EXAMPLE 2-1 _ Let f(r) be a unit step function that is defined to have a constant value 
of unity for t > 0 and a zero value for ¢ < 0. Or, 


S(t) = u(t) (2-9) 
Then the Laplace transform of f(t) is 


F(s) = £[u,(t)] = J * ud(te~* de 


= ——e-s 


1 
=i (2-10) 


0 


Of course, the Laplace transform given by Eq. (2-10) is valid if 
(i lu,(t)e-#|dt = t- lene dt <0 


which means that the real part of s, @, must be greater than zero. However, in practice, 
we simply refer to the Laplace transform of the unit step function as 1/s, and rarely do 
we have to be concerned about the region in which the transform integral converges 
absolutely. 


EXAMPLE 2-2 Consider the exponential function 


{O+e", (20 


where a is a constant. 
The Laplace transform of f(t) is written 


F(s) = 7 e-te-st d¢ = me seas 2 = pil (2-1 1) 
: sta P s+a 


Inverse Laplace Transformation 


The operation of obtaining f(¢) from the Laplace transform F(s) is termed 
the inverse Laplace transformation. The inverse Laplace transform of F(s) is 
denoted by 


f() = £"[F(s)] (2-12) 
and is given by the inverse Laplace transform integral 
ee ee ae oe ; 
fO= Inf | oye F(s)e" ds (2-13) 


where c is a real constant that is greater than the real parts of all the singularities 
of F(s). Equation (2-13) represents a line integral that is to be evaluated in 
the s-plane. However, for most engineering purposes the inverse Laplace trans- 
form operation can be accomplished simply by referring to the Laplace trans- 
form table, such as the one given in Appendix B. 


Important Theorems of the Laplace Transform 


The applications of the Laplace transform in many instances are simplified 
by the utilization of the properties of the transform. These properties are 
presented in the following in the form of theorems, and no proofs are given. 
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1. Multiplication by a Constant 


The Laplace transform of the product of a constant k and a time func- 
tion f(t) is the constant k multiplied by the Laplace transform of f(t); 
that is, 


L[k f(@)] = KF(s) (2-14) 
where F(s) is the Laplace transform of f(¢). 


2. Sum and Difference 


The Laplace transform of the sum (or difference) of two time functions 
is the sum (or difference) of the Laplace transforms of the time func- 
tions; that is, 

LAO +tAO] = AiG) + Fits) (2-15) 


where F,(s) and F,(s) are the Laplace transforms of f,(¢) and f,(0), 
respectively. 


3. Differentiation 


The Laplace transform of the first derivative of a time function f(t) 
is s times the Laplace transform of f(t) minus the limit of f(t) ast 
approaches 0-+- ; that is, 


a 260 =a) — in 5 


= sF(s) — f(0+) 
In general, for higher-order derivatives, 


of SFO] = srF(s) — Jim [sro + 2 fO ...4F £0 


(2-16) 


dt 
= sF(s) — 81 fO-+) — 2 fPO+) —...— fe-PO+F) 
(2-17) 


4. Integration 


The Laplace transform of the first integral of a function f(t) with 
respect to time is the Laplace transform of f(t) divided by s; that is, 


al [ f@) a |= x As) (2-18) 


In general, for nth-order integration, 


4 [ ib we (e f(t) de dt, seins | = 4) (2-19) 


5. Shift in Time 


The Laplace transform of f(t) delayed by time T is equal to the Laplace 
transform of f(t) multiplied by eT; that is, 


LUf(t — Tyu,(t — TY) = Fs) (2-20) 


where u,(t — T) denotes the unit step function, which is shifted in 
time to the right by 7. 
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6. Initial-Value Theorem 
If the Laplace transform of f(t) is F(s), then 


lim f() = lim sF(s) (2-21) 


if the time limit exists. 

7. Final-Value Theorem 
If the Laplace transform of f(t) is F(s) and if sF (s) is analytic on the 
imaginary axis and in the right half of the s-plane, then 


lim f(t) = lim SF(s) (2-22) 


The final-value theorem is a very useful relation in the analysis and design 
of feedback control systems, since it gives the final value of a time function by 
determining the behavior of its Laplace transform as s tends to zero. However, 
the final-value theorem is not valid if sF(s) contains any poles whose real part 
is Zero or positive, which is equivalent to the analytic requirement of sF(s) 
stated in the theorem. The following examples illustrate the care that one must 
take in applying the final-value theorem. 


EXAMPLE 2-3. Consider the function 

a 

s(s? + 5 + 2) 

Since sF(s) is analytic on the imaginary axis and in the right half of the s-plane, the 
final-value theorem may be applied. Therefore, using Eq. (2-22), 


5 5 


F(s) = 


poh@) Stee) = Nae 23 
EXAMPLE 2-4 Consider the function 
@ 


which is known to be the Laplace transform of F(t) = sin wrt. Since the function sF' (s) 
has two poles on the imaginary axis, the final-value theorem cannot be applied in this 
case. In other words, although the final-value theorem would yield a value of zero as 
the final value of f(t), the result is erroneous. 


2.4 Inverse Laplace Transform by Partial-Fraction Expansion7"!! 


In a great majority of the problems in control systems, the evaluation of the 
inverse Laplace transform does not necessitate the use of the inversion integral 
of Eq. (2-13). The inverse Laplace transform operation involving rational func- 
tions can be carried out using a Laplace transform table and partial-fraction 
expansion. 

When the Laplace transform solution of a differential equation is a rational 
function in s, it can be written 


X(s) = 29) (2-25) 
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where P(s) and Q(s) are polynomials of s. It is assumed that the order of Q(s) 
in s is greater than that of P(s). The polynomial Q(s) may be written 
Os) = s* + ays?) 4... + ay + ay (2-26) 


where a,,..., 4, are real coefficients. The zeros of Q(s) are either real or in 
complex-conjugate pairs, in simple or multiple order. The methods of partial- 
fraction expansion will now be given for the cases of simple poles, multiple- 
order poles, and complex poles, of X(s). 


Partial-Fraction Expansion When All the Poles of X(s) Are Simple and Real 
If all the poles of X(s) are real and simple, Eq. (2-25) can be written 

P(s) _ P(s) -_ 

O(s) (Ss + sis + 52)... + 45x) 


where the poles —s,, —52,..., —S, are considered to be real numbers in the 
present case. Applying the partial-fraction expansion technique, Eq. (2-27) is 
written 


X(s) = (2-27) 


Ky | Kya | + Kya (2-28) 


AS) Ss Vsts, sts, 


The coefficient, K,, (i= 1,2,...,n), is determined by multiplying both sides 
of Eq. (2-28) or (2-27) by the factor (s + s,) and then setting s equal to —s,. 
To find the coefficient K,,, for instance, we multiply both sides of Eq. (2-27) by 
(s + s,) and let s = —s,; that is, 


wz P(s) ee. 6) 
Ki (64a |. Gana oa Ceo 


As an illustrative example, consider the function 


a 5s +3 ‘ 
| XS) = GTINs + DG + 3) Cy) 


which is written in the partial-fractioned form 
K -1 i K -2 


The coefficients K_,, K_,, and K_, are determined as follows: 
= —~ ¢A-)+3_.. 
K_, =[(s + )XG)L--1 = NG)" —1 (2-32) 
= (s+ _ X=2+3 
K., = [(s 2)X(s)},--2 = a =e 23 a 2) = 7 (2-33) 
=o 4 ee) on) See 
K_,=[(s + )X@)L--3 = q=ayg— 3H 7 ~° (2-34) 
| Therefore, Eq. (2-31) becomes 
2224 7 6 
| 5 ase ye ay ee) 
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Partial-Fraction Expansion When Some Poles of X(s) Are of Multiple Order 


If r of the n poles of X(s) are identical, or say, the pole at s = —s, is of 
multiplicity r, X(s) is written 
P(s) P(s) 
X(s) = Bs = SSS 2-36 
OO)" CFG ts).CtaGrH 29 
Then X(s) can be expanded as 
= Ky; Ky, K,, 
A eas, Peg PI h gage 
|<— - —r) oe of simple ae —| (2-37) 
1 2 r 
Teta @tspt taps 


|<—~ r terms of repeated poles —>| 
The n ~ r coefficients, which correspond to simple poles, K,,, Kj, ... » Kags 


may be evaluated by the method described by Eq. (2-29). The determination of 
the coefficients that correspond to the multiple-order poles is described below. 


r=[(s + 5)'X(s)],--s, (2-38) 


Ars = 216 + 5)'X(s)I|_ (2-39) 
Ara = BU + 5) XO) (2-40) 
roa "2! ds? : ete 
Ay = FOS + 8X (2-41) 
‘= Dlds™ : peer 
ExAmpLe 2-5 Consider the function 
= I 
*O = GEDETD ee 
Using the format of Eq. (2-37), X(s) is written 
Ke x Ko A Ay A; 
X(s) oS e2 se1 > Gai’ Gt pt (2-43) 
Then the coefficients corresponding to the simple poles are 
Ky = [sX(s)],<0 = 4 (2-44) 
Kz = [8 + 2X (so. = 4 (2-45) 
and those of the third-order poles are 
A; =[(s + 1)? X(s)]|,--1= —1 (2-46) 
Ar = FI + IP XG] = rakoeet ll 
_ —(2s +2) 6 Can 
st(s + 2)? |.) 
and 
1 d2 1 df—2 1 
A, = a gals + 1° X(s)] ee 3 alter | as 
=[ =1, Ast) | AS 41) aly Cs) 
Ss 4+ 2)% " ss +23 T sis + 23] a el 
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The completed partial-fraction expansion is 
1 


1 1 1 
XW) = 35 +a ~ F4+1~ GF D 


(2-49) 


Partial-Fraction Expansion of Simple Complex-Conjugate Poles 


The partial-fraction expansion of Eq. (2-28) is valid also for simple complex- 
conjugate poles. However, since complex-conjugate poles are more difficult to 
handle and are of special interest in control-systems studies, they deserve sepa- 
rate treatment here. 

Suppose that the rational function X(s) of Eq. (2-25) contains a pair of 
complex poles: 

s=—-at+jo and S=-a—jo 
Then the corresponding coefficients of these poles are 
Kiasja — (s + a — j@)X(s) ecveye (2-50) 
Kua jo = (8 + & + J0)X(8) Jena so (2-51) 


EXAMPLE 2-6 Consider the function 
On 
s(s? + 20@,s + 2) 
Let us assume that the values of € and , are such that the nonzero poles of X(s) are 
complex numbers. Then X(s) is expanded as follows: 


X(s) = (2-52) 


x() = 804 Reet + Ree (2-53) 
where 
a= lo, (2-54) 
and 
o=av1 — C (2-55) 
The coefficients in Eq. (2-53) are determined as 
Ko = 5X(5)|s-0 = 1 (2-56) 
Katja = (s+@ — {@)X(S)|se-a+jo 
= On Dn 9 0642/2) ee 
2ja(-—4+j@) 2 
where 
6 = tan-! [- 2 | (2-58) 
Also, 


K 4-j0 —= (s + % +{@)X(S)|s=-a-jo 
a On. On i042, 2) Go”) 
—2ja(—a4@ —j@) 2@ 


The complete expansion is 


Gel e@—J(8+2/2) ef (8+n/2) | (2-60) 
S 


ee 
XO= > + tolspa—jo + s+adjo 
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Taking the inverse Laplace transform on both sides of the last equation gives 


x(t) =1+4 FE (e-N+a/Bel-at Joy + 1 (0+n/2)@(—a— ja)t) 
(2-61) 
On op: 
= 1+ Gfe-™ sin(wr — 8) 


or 
earl! Oram 
V1 — C2 
where @ is given by Eq. (2-58). 


x(t) = 1+ eto sin(ca,r/1 — C2 ¢ — 8) (2-62) 


2.5 Application of Laplace Transform to the Solution of Linear 
Ordinary Differential Equations 


With the aid of the theorems concerning Laplace transform given in Section 
2.3 and a table of transforms, linear ordinary differential equations can be 
solved by the Laplace transform method. The advantages with the Laplace 
transform method are that, with the aid of a transform table the steps involved 
are all algebraic, and the homogeneous solution and the particular integral 
solution are obtained simultaneously. 

Let us illustrate the method by several illustrative examples. 


EXAMPLE 2-7 Consider the differential equation 


FO 4 3B) + 2500) = Sut) (2-63) 
where u,(t) is the unit step function, which is defined as 
Gym {" t>0 (2-64) 
0 t<0 


The initial conditions are x(0+) = —1 and x‘? (0+) = dx(t)/dt l=o+ = 2. To solve 
the differential equation we first take the Laplace transform on both sides of Eq. (2-63); 
we have 


ve? 
S*7X(s) — sx(O+) — x)(0-+) + 35X(s) — 3x(0+) + 2X(s) = 2 (2-65) 


Substituting the values of x(0+-) and x‘? (0+) into Eq. (2-65) and solving for X(s), we 


get 
— —s—st5 —s?~s+5 e 
XO) = SGT 3s+D = ss ne + 2) (2-66) 
Equation (2-66) is expanded by partial-fraction expansion to give 
me) 5 3 
MS 5, Se ae D 280) 


Now taking the inverse Laplace transform of the last equation, we get the complete 
solution as 

x(t) = % —Set+fe-®# = t > 0 (2-68) 

The first term in the last equation is the steady-state solution, and the last two 

terms are the transient solution. Unlike the classical method, which requires separate 
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Steps to give the transient and the steady-state solutions, the Laplace transform method 
gives the entire solution of the differential equation in one operation. 

If only the magnitude of the steady-state solution is of interest, the final-value 
theorem may be applied. Thus 


—st+5_ 2 
jim x(t) = lim sX(s) = lim = ~ 35+2.. 


where we have first checked and found that the function, sX(s), has poles only in the 
left half of the s-plane. 


(2-69) 


EXAMPLE 2-8 Consider the linear differential equation 


2 
gd) + 34,52) + 1000x(t) = 1000u,(r) (2-70) 
dt? at 
where u,(f) is the unit step function. The initial values of x(t) and dx(t)/dt are assumed 


to be zero. 
Taking the Laplace transform on both sides of Eq. (2-70) and applying zero initial 
conditions, we have 
me 


s2X(s) + 34.5sX(s) + 1000X(s) = (2-71) 
Solving X(s) from the last equation, we obtain 
x= 700 (2-72) 


s(s? + 34.5s + 1000) 
The poles of X(s) are at s = 0, s = —17.25 + j26.5, and s = —17.25 — j26.5. There- 
fore, Eq. (2-72) can be written as 


X@) = 1000 


s(s + 17.25 — 726.5)(s + 17.25 + 726.5) 


One way of solving for x(t) is to perform the partial-fraction expansion of Eq. 
(2-73), giving 


(2-73) 


31.6 e7i(O+n/2) ei (O+n/2) 
X@)=++ 3(26. 653 F725 — 7265 + SF ITS + 7365 Cat) 
where 
ee ‘ 
6 = tan (7782 7 $2) = ~56.9 (2-75) 
e Then, using Eq. (2-61), 
x(t) = 1 + 1.193e-17-25¢ sin(26.5¢ — 0) (2-76) 
Another approach is to compare Eq. (2-72) with Eq. (2-52), so that 
@, = 4/1000 = +31.6 (2-77) 
and 
€ = 0.546 (2-78) 


and the solution to x(t) is given directly by Eq. (2-62). 


2.6 Elementary Matrix Theory!:2:6 


In the study of modern control theory it is often desirable to use matrix notation 
to simplify complex mathematical expressions. The simplifying matrix notation 
may not reduce the amount of work required to solve the mathematical equa- 
tions, but it usually makes the equations much easier to handle and manipulate. 
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As a motivation to the reason of using matrix notation, let us consider 
the following set of n simultaneous algebraic equations: 
@11X1 + Qy2X2 +... + a1,X%, =), 

Q21X1 + Az2X2 +... + Aa_X, = Vo (2-79) 


Ani X11 AqaX2 +... + AnyXy = Vp 
We may use the matrix equation 
Ax=y (2-80) 
as a simplified representation for Eq. (2-79). 

The symbols A, x, and y are defined as matrices, which contain the coeffi- 
cients and variables of the original equations as their elements. In terms of matrix 
algebra, which will be discussed later, Eq. (2-80) can be stated as: The product 
of the matrices A and x is equal to the matrix y. The three matrices involved here 
are defined to be 

Qi, Gyn «ey, 
Az, Anz «es Aan 


a (2-81) 
x=] ° (2-82) 


y=\- (2-83) 


Vn 
which are simply bracketed arrays of coefficients and variables. Thus, we can 
define a matrix as follows: 
Definition of a Matrix 


A matrix is a collection of elements arranged in a rectangular or square array. 
Several ways of representing a matrix are as follows: 


0 3 10 0 3 10 
re ae 
F a, 0 i a 


0 3 10 
1 —2 ol) A= [4:j]2,3 


In this text we shall use square brackets to represent the matrix. 


A= 
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It is important to distinguish between a matrix and a determinant: 


Matrix Determinant 
An array of numbers or elements An array of numbers or elements 
with n rows and m columns. with n rows and n columns (always 


Does not have a value, although a square). 
square matrix (n = m) hasadeter- Has a value. 
minant. 


Some important definitions of matrices are given in the following. 


Matrix elements. When a matrix is written 
Qi, Ayn 33 
A=]|@21 22 423 (2-84) 
Q3, G32 33 


a;, is identified as the element in the ith row and the jth co/umn of the matrix. 
As a rule, we always refer to the row first and the column last. 


Order of a matrix. The order of a matrix refers to the total number of 
rows and columns of the matrix. For example, the matrix in Eq. (2-84) has three 
rows and three columns and, therefore, is called a3 x 3 (three by three) matrix. 
In general, a matrix with 2 rows and m columns is termed “n < m” or “n by m.” 


Square matrix. A square matrix is one that has the same number of rows 
as columns. 


Column matrix. A column matrix is one that has one column and more 
than one row, that is, anm X 1 matrix,m > 1. 

Quite often, a column matrix is referred to as a co/uimn vector or simply 
an m-vector if there are m rows. The matrix in Eq. (2-82) is a typical column 
matrix that ism x 1, or an n-vector. 


Row matrix. A row matrix is one that has one row and more than one 
column, that is, a 1 X n matrix. A row matrix can also be referred to as a row 
vector. 


Diagonal matrix. A diagonal matrix is a square matrix with a,,; = 0 for 
all i + j. Examples of a diagonal matrix are 


is : : shee 2-85) 
a > a 
* 0 3 ¢ 

0 0 433 


Unity matrix (Identity matrix). A unity matrix is a diagonal matrix with 
all the elements on the main diagonal (i = j) equal to I. A unity matrix is often 


designated by I or U. An example of a unity matrix is 
100 
I= 0 (2-86) 
1 


0 1 
0 0 


Sec. 2.6 Elementary Matrix Theory / 29 


Null matrix. A null matrix is one whose elements are all equal to zero; 


for example, 
00 0 
Oo= 2-87 
i 0 0 ae) 


Symmetric matrix. A symmetric matrix is a square matrix that satisfies 
the condition 
ay = ay, (2-88) 
for ail i and j. A symmetric matrix has the property that if its rows are inter- 
changed with its columns, the same matrix is preserved. Two examples of sym- 
metric matrices are 
1 


6 5 ; 
5 0 10], | | (2-89) 

4 
DAO: 4 


Determinant of a matrix. With each square matrix a determinant having 
the same elements and order as the matrix may be defined. The determinant of 
@ square matrix A is designated by 


det A = A, ={A| (2-90) 
As an illustrative example, consider the matrix 
10 —I 
A=| 0 3 2 (2-91) 
—1 1 0 
The determinant of A is 
10-1 
|AJ[=} 0 3 2/= —5 (2-92) 
—1 1 0 


Singular matrix. A square matrix is said to be singular if the value of its 
determinant is zero. On the other hand, if a square matrix has a nonzero deter- 
minant, it is called a nonsingular matrix. 

When a matrix is singular, it usually means that not all the rows or not all 
the columns of the matrix are independent of each other. When the matrix is 
used to represent a set of algebraic equations, singularity of the matrix means 
that these equations are not independent of each other. As an illustrative exam- 
ple, let us consider the following set of equations: 


2x, — 3x, + x,;=0 
—X,+ XxX, + x,=0 (2-93) 
x, — 2x, + 2x, =0 


Note that in Eq. (2-93), the third equation is equal to the sum of the first two 
equations, Therefore, these three equations are not completely independent. 
In matrix form, these equations may be represented by 


AX=O 
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where 
2 -3 1 
= |/—! 1 1 (2-94) 
1 —2 2 
x 
X=!/x, (2-95) 
X3 


and O is a3 x 1 null matrix. The determinant of A is 


2-3 1 
|A|=]-1 1 1;=4—-3+2-—-1-—-6+4+4=0 (2-96) 
1 —2 2 
Therefore, the matrix A of Eq. (2-94) is singular. In this case the rows of A are 


dependent. 


Transpose of a matrix. The transpose of a matrix A is defined as the matrix 
that is obtained by interchanging the corresponding rows and columns in A. 
Let A be ann X m matrix which is represented by 


A= [aj )n, m (2-97) 
Then the transpose of A, denoted by A’, is given by 
A’ = transpose of A = [4jiln,n (2-98) 


Notice that the order of Ais X m; the transpose of A has an order m X a. 
EXAMPLE 2-9 As an example of the transpose of a matrix, consider the matrix 
lf 2 | 
A= 
0 -1 5 


The transpose of A is given by 


Skew-symmetric matrix. A skew-symmetric matrix is a square matrix 
that equals its negative transpose; that is, 


kee (2-99) 


Some Operations of a Matrix Transpose 


1 (A’)=A (2-100) 
2. (kA)' = kA’, where k is a scalar (2-101) 
3, (A+ BY =A’'4+ B’ (2-102) 


4, (AB)’ = B’A’ (2-103) 
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Adjoint of a matrix. Let A be a square matrix of order n. The adjoint 
matrix of A, denoted by adj A, is defined as 
adj A = [ij cofactor of det AY’, , (2-104) 


where the ij cofactor of the determinant of A is the determinant obtained by omit- 
ting the ith row and the jth column of |A| and then multiplying it by (—D/, 


EXAMPLE 2-10 As an example of determining the adjoint matrix, let us consider 
first a 2 x 2 matrix, 


411 412 
A =| 
Q21 22 


411 Qi2 


The determinant of A is 


|A| = 


G21 22 


The 1,1 cofactor, or the cofactor of the (1, 1) element of | A], is a2; the 1,2 cofactor is 
—ay,; the 2,1 cofactor is —a,2; and the 2,2 cofactor is a,,. Thus, from Eq. (2-104), 


the adjoint matrix of A is 
. [1,1 cofactor 1,2 cofactor |’ 
adj A = 


L2,1 cofactor 2,2 cofactor 
[1,1 cofactor 2,1 cofactor 


= | (2-105) 


1,2 cofactor 2,2 cofactor 


sil a22 ia 


L—@21 ait 


EXAMPLE 2-11 As a second example of the adjoint matrix, consider 
41 432 3 
A=] 421 422 23 (2-106) 
43, 432 433 
Then 
[1,1 cofactor 2,1 cofactor 3,1 cofactor 
adj A =| 1,2 cofactor 2,2 cofactor 3,2 cofactor 
L1,3 cofactor 2,3 cofactor 3,3 cofactor 


[ (@z2€33 — @23@32) —(412433 — 413432) (412423 — 41322) 
=| —(@21433 — 23031) (411433 — 413431) —(@11423 — 413@21) 
L (@21432 — @22€31) —(411432 — 412431) (411422 — @12421) 


(2-107) 


Conjugate matrix. Given a matrix A whose elements are represented by 
a;;, the conjugate of A, denoted by A, is obtained by replacing the elements of A 
by their complex conjugates; that is, 
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A = conjugate matrix of A 
= [4,,] 


where G,, = complex conjugate of a,;. 


(2-108) 


2.7 Matrix Algebra 


When carrying out matrix operations it is necessary to define matrix algebra in 
the form of addition, subtraction, multiplication, division, and other necessary 
operations. It is important to point out at this stage that matrix operations are 
defined independently of the algebraic operations for scalar quantities. 
Equality of Matrices 

Two matrices A and B are said to be equal to each other if they satisfy the 
following conditions: 


1. They are of the same order. 
2. The corresponding elements are equal; that is, 


a, = bi; for every i and j 


a=|2 lt ~ (2-109) 
Gr, 22 boi ba2 


implies that a,; = 511, 412 = Dia, G21 = by, and ag, = 22. 


For example, 


Addition of Matrices 


Two matrices A and B can be added to form A + Bif they are of the same 
order. Then 


A+ B= [@ishn, m + [bisls, m =C= [Cij|n, m (2-110) 
where 
Cy = ay + bi; (2-111) 


for all i and j. The order of the matrices is preserved after addition. 


EXAMPLE 2-12 _As an illustrative example, consider the two matrices 


a. 0 3 
A=|-1 4] Be=|-1 2 
‘ae 1 0 


which are of the same order. Then the sum of A and B is given by 
3+0 2+3 3 5 
C=A+B=j;-1-1 4+2)=| -2 6 (2-112) 
O+1 —-14+0 1 —1 
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Matrix Subtraction 


The rules governing the subtraction of matrices are similar to those of 
matrix addition. In other words, Eqs. (2-1 10) and (2-111) are true if all the plus 
signs are replaced by minus signs. Or, 


C= A—B= [@ijhn, m > [Bij)n, m 


= [4i),,m + [~Buy]n, m (2-113) 
— [Cej)n, m 
where 
Cy = ay — by (2-114) 


for all i and j. 


Associate Law of Matrix (Addition and Subtraction) 


The associate law of scalar algebra still holds for matrix addition and 
subtraction. Therefore, 


(A+B)+C=A+(B+C0) (2-115) 
Commutative Law of Matrix (Addition and Subtraction) 


The commutative law for matrix addition and subtraction states that the 
following matrix relationship is true: 
A+B+C=B+C+A 
- aia (2-116) 
=A+C4+B 


Matrix Multiplication 


The matrices A and B may be multiplied together to form the product AB 
if they are conformable. This means that the number of columns of A must equal 
the number of rows of B. In other words, let 


A > [@ij)n, p 
B = [Bislo, m 
Then A and B are conformable to form the product 
C = AB = [ais], aLijda, m =< [eudn, m (2-117) 


if and only if p = g. The matrix C will have the same number of rows as A and 
the same number of columns as B. 

It is important to note that A and B may be conformable for AB, but they 
may not be conformable for the product BA, unless in Eq. (2-117) n also equals 
m. This points out an important fact that the commutative law is not generally 
valid for matrix multiplication. It is also noteworthy that even though A and B 
are conformable for both AB and BA, usually AB + BA. In general, the follow- 
ing references are made with respect to matrix multiplication whenever they 
exist: 

AB = A postmultiplied by B 


AB = B premultiplied by A 


or 
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Having established the condition for matrix multiplication, let us now turn 
to the rule of matrix multiplication. When the matrices A and B are conformable 
to form the matrix C = ABas in Eq. (2-117), the ijth element of C, ¢,,, is given by 


a oe > xD x; (2-118) 
k= 
fori=1,2,...,n,andj=1,2,...,m. 


EXAMPLE 2-13 Given the matrices 
A= [a;jJ2,3 B= [b;j)3,1 


we notice that these two matrices are conformable for the product AB but not for BA. 


Thus, 
Qi1 Aj2 43 | 
AB =| i 
G21 G22 423 ss (2-119) 
- (ou + @y2b21 + ) 
© Lazybiy + @a2b21 + aasba1 


EXAMPLE 2-14 Given the matrices 


3 -1 
10 -Il 
A=j|0 1|, B= | | 
2 1 0 
2 0 
we notice that both AB and BA are conformable for multiplication, 
f Bele We es 
we ota 
2 1 0. 
2 0. 
(3)0) + (—DQ2) 3)O)+(-DG) BX~-1) + (-1)O) 
= (2-120) 


(01) + 2) = ©)0) + (A) OLD + CO) 
(21) + OZ) (20+ O00) @—1) + OO) 


1 -1 -—3 

= 12 1 0 

2 0 —2 

ss 3-1 
10-1 

BA = 0 1 
L2 1 0 


F(D3) + OO) + (-—YN2) G(—-) + OG + a (2-121) 
L(2)(3) + (©) + 2) 2-1) + CA) + OO) 


fl = 
“Le -1 
Therefore, even though AB and BA may both exist, in general, they are not equal. 
In this case the products are not even of the same order. 
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Although the commutative law does not hold in general for matrix multi- 
plication, the associative and the distributive laws are valid. For the distributive 
law, we state that 

A(B + C) = AB + AC (2-122) 


if the products are conformable. 
For the associative law, 
(AB)C = A(BC) (2-123) 


if the product is conformable. 


Multiplication by a Scalar k 


Multiplying a matrix A by any scalar & is equivalent to multiplying each 
element of A by k. Therefore, if A = [a;;], m 


(2-124) 
kA = [Kai jl, m 
Inverse of a Matrix (Matrix Division) 
In the algebra for scalar quantities, when we write 
ax=y (2-125) 
it leads to 
x=y (2-126) 
or 
x=a'y (2-127) 
Equations (2-126) and (2-127) are notationally equivalent. 
In matrix algebra, if 
Ax =y (2-128) 
then it may be possible to write 
x=Avly (2-129) 


where A“! denotes the “inverse of A.” The conditions that A~! exists are: 


1. A is a square matrix. 
2. A must be nonsingular. 


If A~! exists, it is given by 


e djA 
A-t = 2 2-130 
[A] ( ) 
EXAMPLE 2-15 Given the matrix 
[ a 
fae =| (2-131) 
L@21 422 
the inverse of A is given by 
| 422 —a | 
adj A —a2z1 ay (2-1 32) 


|A| 411422 — 412421 
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where for A to be nonsingular, |A| = 0, or 
@1 1422 — 412421 #O (2-133) 


If we pay attention to the adjoint matrix of A, which is the numerator of A~ 1, we 
see that for a 2 Xx 2 matrix, adj A is obtained by interchanging the two elements on 
the main diagonal and changing the signs of the elements on the off diagonal of A. 


EXAMPLE 2-16 Given the matrix 


1 1 
A=|-1 0 2 (2-134) 
111 
the determinant of A is 
1 1 0 
|A|=|—1 0 2})=1 (2-135) 
1 i 1 
Therefore, A has an inverse matrix, and is given by 
—2 -1 2 
Atl= 3 1 -—2 (2-136) 
—1 0 1 
Some Properties of Matrix Inverse 
1. AA7'=ATA=I (2-137) 
2, (ANyI=A (2-138) 
3. In matrix algebra, in general, 
AB = AC (2-139) 


does not necessarily imply B = C. The reader can easily construct 
an example to illustrate this property. However, if A is a square 
matrix, and is nonsingular, we can premultiply both sides of Eq. 
(2-139) by A~!. Then 


A AB = A“!AC (2-140) 
or 
IB = IC (2-141) 
which leads to 
B=C 


4. If A and B are square matrices and are nonsingular, then 
(AB)-! = B-'A™! (2-142) 
Rank of a Matrix 


The rank of a matrix A is the maximum number of linearly independent 
columns of A; or, it is the order of the largest nonsingular matrix contained in 
A. Several examples on the rank of a matrix are as follows: 


Sec. 2.7 ; Matrix Algebra / 37 


ke 1 rank = 1 fe 24 | rank = 2 
0 0 , 3 0 3 2 ° 
3 9 2 3 0 0 

1 3 O} rank = 2, 1 2 0} rank =3 

2 6 1 00 1 


The following properties on rank are useful in the determination of the rank 
of a matrix. Given an 7 x m matrix A, 


1. Rank of A = Rank of A’. 
2. Rank of A = Rank of A’A. 
3. Rank of A = Rank of AA’. 


Properties 2 and 3 are useful in the determination of rank; since A’A and AA’ 
are always square, the rank condition can be checked by evaluating the deter- 
minant of these matrices. 


Quadratic Forms 


Consider the scalar function 


{@~= ba p> Q)X)X, (2-143) 
which is called the quadratic form. We can write this equation as 
f@) = Bx 3S ayx, (2-144) 
Let 
Ji = > QjjX; (2-145) 
Then Eq. (2-144) becomes 
FO) = Y xo (2-146) 
Now if we define 
x1 V1 
X2 y2 
x = 9 y = . 
xn Vn 
Eq. (2-146) can be written 
f(%) = x’y (2-147) 
and from Eq. (2-145), 
y = Ax (2-148) 


where 
A = [4:j]n, n (2- I 49) 
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Finally, f(x) becomes 

f(x) = x’Ax (2-150) 
Since the coefficient of x;x, is a, + a; for i j, given any quadratic form as in 
Eq. (2-150), we can always replace A with a symmetric matrix. In other words, 
given any A, we can always define a symmetric matrix B such that 


by = by =, ei (2-151) 


The quadratic forms are often used as performance indices in control 
systems design, since they usually lead to mathematical conveniences in the 
design algorithms. 


Definiteness 


Positive definite. An n X n matrix A is said to be positive definite if all 
the roots of the equation 
j|AL— A|=0 (2-152) 
are positive. Equation (2-152) is called the characteristic equation of A, and the 
roots are referred to as the eigenvalues of A. 


Positive semidefinite. The matrix A (n X n) is positive semidefinite if all 
its eigenvalues are nonnegative and at least one of the eigenvalues is zero. 


Negative definite. The matrix A (” x n) is negative semidefinite if all its 
eigenvalues are nonpositive and at least one of the eigenvalues is zero. 


Indefinite. The matrix A (n X n) is indefinite if some of the eigenvalues are 
negative and some are positive. 

An alternative way of testing the definiteness of a square matrix is to check 
the signs of all the leading principal minors of the matrix. The leading principal 
minors of an n X n matrix A are defined as follows. Given the square matrix 


Ay, Ayn «ee Ary 

Ax, G22 «++ Gan 
A= 

Qn anr eee Any 


the n leading principal minors are the following determinants: 


Qi, Giz 413 
Q13 As2 


ai Qo, G22 G23] --- |A| 


G21 Arr 
43, 432 433 
Then the definiteness of A is determined as follows: 
A is positive (negative) definite if all the leading principal minors of A are 
positive (negative). 
A is positive semidefinite if | A| = 0 and all the leading principal minors of 
A are nonnegative. 
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A is negative semidefinite if | A] = 0 and all the leading principal minors 
of —A are nonnegative. 

We may also refer to the definiteness of the quadratic form, x’Ax, 

The quadratic form, x’Ax (A is symmetric), is positive definite (positive 
semidefinite, negative definite, negative semidefinite) if the matrix A is positive 
definite (positive semidefinite, negative definite, negative semidefinite). 


2.8 z-Transform!2.13 


The Laplace transform is a powerful tool for the analysis and design of linear 
time-invariant control systems with continuous data. However, for linear sys- 
tems with sampled or discrete data, we may find that the z-transform is more 
appropriate. 

Let us first consider the analysis of a discrete-data system which is repre- 
sented by the block diagram of Fig. 2-3. One way of describing the discrete 
nature of the signals is to consider that the input and the output of the system 
are sequences of numbers. These numbers are spaced T seconds apart. Thus, 
the input sequence and the output sequence may be represented by r(kT) and 
c(kT), respectively, k= 0, 1, 2, .... To represent these input and output 
sequences by time-domain expressions, the numbers are represented by impulse 
functions in such a way that the strengths of the impulses correspond to the 
values of these numbers at the corresponding time instants. This way, the input 
sequence is expressed as a train of impulses, 


roO= S r(kT)6(t — kT) (2-153) 


A similar expression can be written for the output sequence. 


Discrete-data 
system 


Fig. 2-3. Block diagram of a discrete-data Fig. 2-4. Block diagram of a 
system. finite-pulsewidth sampler. 


Another type of system that has discontinuous signals is the sampled-data 
system. A sampled-data system is characterized by having samplers in the system. 
A sampler is a device that converts continuous data into some form of sampled 
data. For example, Fig. 2-4 shows the block diagram of a typical sampler that 
closes for a very short duration of p seconds once every T seconds. This is referred 
to as a sampler with a uniform sampling period T and a finite sampling duration p. 
Figure 2-5 illustrates a set of typical input and output signals of the sampler. 

With the notation of Figs. 2-4 and 2-5, the output of the finite-pulse-dura- 
tion sampler is written 


30) =r) DS tue — kT) — u(t — kT = p)] (2-154) 


where u,(t) is the unit step function. 
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r(f) 


ry(t) p 
t t 
9 ip T 2T 


Fig. 2-5. Input and output signals of a finite-pulsewidth sampler. 


For small p, that is, p< T, the narrow-width pulses of Fig. 2-5 may be 
approximated by flat-topped pulses. In other words, Eq. (2-154) can be written 
ret) ~ ¥ r(kT)[u(t — kT) — u(t — kT — p)| (2-155) 


k=0 


Multiplying both sides of Eq. (2-155) by 1/p and taking the limit as p approaches 
zero, we have 


P i At ~ 1 a _ 
lim Pipher >» p eMule kT) —u,(t — kT — p)] 


= = r(kT)5(t — kT) 
=0 
or 
lim Lr) ~ (2-156) 
p+0 DP 
In arriving at this result we have made use of the fact that 
5() = tim fu, — u(t — pl (2-157) 
p70 Pp 


The significance of Eq. (2-156) is that the output of the finite-pulsewidth 
sampler can be approximated by a train of impulses if the pulsewidth approaches 
zero in the limit. A sampler whose output is a train of impulses with the strength 
of each impulse equal to the magnitude of the input at the corresponding sam- 
pling instant is called an ideal sampler. Figure 2-6 shows the block diagram of 
an ideal sampler connected in cascade with a constant factor p so that the com- 
bination is an approximation to the finite-pulsewidth sampler of Fig. 2-4 if p is 
very small. Figure 2-7 illustrates the typical input and output signals of an ideal 
sampler; the arrows are used to represent impulses with the heights representing 
the strengths (or areas) of the latter. 


r(t) * r*(t) = | = rp (t) 
T 


Ideal sampler 


Fig. 2-6. Approximation of a finite-pulsewidth sampler by an ideal sam- 
pler and a cascade constant factor. 
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r(t) r*(t) 


9 ‘ OT or3rar 


Fig. 2-7. Input and output signals of an ideal sampler. 


In view of these considerations we may now use the ideal sampler to repre- 
sent the discrete data, r(kT). This points to the fact that the signals of thesystem 
in Fig. 2-3 can essentially be treated as outputs of ideal samplers. 

Now we are ready to investigate the application of transform methods to 
discrete and sampled-data systems. Taking the Laplace transform on both 
sides of Eq. (2-153), we have 

R*(s) = kT )e* (2-158) 
The fact that Eq. (2-158) contains the exponential term e~*7* reveals the difficulty 
of using Laplace transform for the general treatment of discrete-data systems, 
since the transfer function relations will no longer be algebraic as in the continu- 
ous-data case. Although it is conceptually simple to perform inverse Laplace 
transform on algebraic transfer relations, it is not a simple matter to perform 
inverse Laplace transform on transcendental functions. One simple fact is that 
the commonly used Laplace transform tables do not have entries with trans- 
cendental functions in s. This necessitates the use of the z-transform. Our moti- 
vation here for the generation of the z-transform is simply to convert trans- 
cendental functions in s into algebraic ones in z. The definition of z-transform 
is given with this objective in mind. 


Definition of the z-Transform 


The z-transform is defined as 

z= er (2-159) 

where s is the Laplace transform variable and Tis the sampling period. Equation 
(2-159) also leads to 


s =alnz (2-160) 
Using Eq. (2-159), the expression in Eq. (2-158) is written 
R* (s = 7 In z) = R(z) = Yo (kT) 2-* (2-161) 
k=0 


or 
R(z) = z-transform of r*(t) 


= alr*(2)] (2-162) 
= [Laplace transform of r*(t)],_, Paz 
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Therefore, we have treated the z-transform as simply a change in variable, 
z= ers, 
The following examples illustrate some of the simple z-transform operations. 


EXAMPLE 2-17 Consider the sequence 


r(kT) =e-"?, =k =0,1,2,... (2-163) 

where a is a constant. 

From Eg. (2-153), 
r*(t) = > e-kT§(t — kT) (2-164) 

=0 
Then 
R*(s) = ¥ e-ekTen As (2-165) 
k=0 


Multiply both sides of Eq. (2-165) by e-(s+a)T and subtract the resulting equation from 
Eq. (2-165); now we can show easily that R*(s) can be written in a closed form, 


1 
R*(s) = [oe ear (2-166) 
for 
Je" @toT | < 1 (2-167) 
where is the real part of s. Then the z-transform of r*(f) is 
R@) = J Z (2-168) 


1—e-7;z! ~7— eat 

for |e~97z-1| <1. 

EXAMPLE 2-18 In Example 2-17, if a = 0, we have 
r(kT) = 1, k =0,1,2,... (2-169) 


which represents a sequence of numbers all equal to unity. Then 


R*(s) = 3 en*T (2-170) 
k=0 
RQ) = Diet aLez2te2pe%+... (2-171) 
This expression is written in closed form as 
R(z) = Ca jz; <1 (2-172) 
or 
R@=s2q IFN} (2-173) 


In general, the z-transforms of more complex functions are obtained by 
use of the same procedure as described in the preceding two examples. If a time 
function r(t) is given as the starting point, the procedure of finding its z-trans- 
form is to first form the sequence r(kT) and then use Eq. (2-161) to get R(2). 
An equivalent interpretation of this step is to send the signal r(¢) through an 
ideal sampler whose output is r*(¢). We then take the Laplace transform 
of r*(t) to give R*(s) as in Eq. (2-158), and R(z) is obtained by substituting 
z for ef. 


. 
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Table 2-1 Table of z-Transforms 


OO eee 


Laplace Transform ‘Time Function Z-Transform 


1 Unit impulse d(t) 1 
1 ‘ 4 
= Unit step u(t) as | 
1 = Sst — ae 
fo Or(t) = 2st nT) re | 
i 1 lz 
s2 (z — 1)2 
1 12 T2z(z + 1) 
53 2 2(z — 1)3 
1 tn . (—1)" on 4 
gett nt _ n! aa(3 = =a) 
1 2 Z 
sta aie z—eaT 
I tenat ieee 
(s + a)? @— earya 
apltas | — eu i es 
s(s + a) (z — I@ — eT) 
ao sin wot zsin@T 
s*+@ z2 — 2zcos@T + 1 
af of 
(0) erot cintgt : ze~T sin @T 
G Fao zeta — QzeaT cos mT + 1 
Ss 2(z — cos wT) 
+o? eaten z4— 2zcos@T + 1 
sta a z2 — ze~aT cos aT 
(s + a)? + @2 fecose z2 — 2ze-T cos wT + e7 20T 


a —— 


Table 2-1 gives the z-transforms of some of the time functions commonly 
used in systems analysis. A more extensive table may be found in the litera- 
ture. 12/13 


Inverse z-Transformation 


Just as in the Laplace transformation, one of the major objectives of the 
z-transformation is that algebraic manipulations can be made first in the z- 
domain, and then the final time response is determined by the inverse z-transfor- 
mation. In general, the inverse z-transformation of R(z) can yield information 
only on r(kT), not on r(t). In other words, the z-transform carries information 
only in a discrete fashion. When the time signal r(t) is sampled by the ideal 
sampler, only information on the signal at the sampling instants, t = kT, is 
retained. With this in mind, the inverse z-transformation can be effected by one 
of the following three methods: 


1, The partial-fraction expansion method. 
2. The power-series method. 
3. The inversion formula. 


Partial-fraction expansion method. The z-transform function RZ) is ex- 
panded by partial-fraction expansion into a sum of simple recognizable terms, 
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and the z-transform table is used to determine the corresponding r(kT). In 
carrying out the partial-fraction expansion, there is a slight difference between 
the z-transform and the Laplace transform procedures. With reference to the z- 
transform table, we note that practically all the transform functions have the 
term z in the numerator. Therefore, we should expand R(z) into the form 
ee K. 12 K,z e 

RQ) = a ps ee (2-174) 
For this, we should first expand R(z)/z into fractions and then multiply z across 
to obtain the final desired expression. The following example will illustrate this 
recommended procedure. 


EXAMPLE 2-19 Given the z-transform function 


(1 — e-%)z 


R@) = @— De ~e-*) (2-175) 
it is desired to find the inverse z-transform. 
Expanding R(z)/z by partial-fraction expansion, we have 
0 a 
z z—-l z-—e7 (2-176) 
Thus, 
0 ee (2-177) 


z—-l z-e% 
From the z-transform table of Table 2-1, the corresponding inverse z-transform of 


R(z) is found to be 
r(kT) = 1 — eT (2-178) 


Power-series method. The z-transform R(z) is expanded into a power 
series in powers of z~!. In view of Eq. (2-161), the coefficient of z~* is the value 
of r(t) at t = kT, or simply r(kT). For example, for the R(z) in Eq. (2-175), we 
expand it into a power series in powers of z~! by long division; then we have 


R@z) = (Ll — eat EL e278 $ (LF 


+e td ez t... (2-179) 
or 
R(z) = >» (1 — e-##r)z-# (2-180) 
Thus, 
(kT) = 1 — ev##? (2-181) 


which is the same result as in Eq. (2-178). 


Inversion formula. The time sequence r(kT" ) may be determined from R(Z) 
by use of the inversion formula, 


(kT) = aaj } Reet de (2-182) 


which is a contour integration’ along the path I’, where I is a circle of radius 
|z| = e*? centered at the origin in the z-plane, and c is of such a value that all 
the poles of R(z) are inside the circle. 
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One way of evaluating the contour integration of Eq. (2-182) is by use of 
the residue theorem of complex variable theory. Equation (2-182) may be 
written 

omnes ik k~1 
r(kT) = Oni 7 R(z)z*"! dz 
= > Residues of R(z)z*~! at the poles of R(z)z*~! (2-183) 
For simple poles, the residues of R(z)z*~1 at the pole z = z ', 18 obtained as 
Residue of R(z)z*~! at the pole z, = (z — z,)R(z)z*"!|,2,, (2-184) 


Now let us consider the same function used in Example 2-19. The function 
R(z) of Eq. (2-175) has two poles: z = 1 and z = e-*, Using Eq. (2-183), we 
have 


(kT) = [Residue of R(z)z*~! at z = 1] + [Residue of R(z)z*-! at z = e~*7] 


_ (= e)zt (1 — e-*T)zt 
al Sa a cae sD ea ae (2-185) 
— ] _— e7okT 


which again agrees with the result obtained earlier. 


Some Important Theorems of the z-Transformation 


Some of the commonly used theorems of the z-transform are stated in the 
following without proof. Just as in the case of the Laplace transform, these 
theorems are useful in many aspects of the z-transform analysis. 


1. Addition and Subtraction 
If r,(KT) and r,(kT) have z-transforms R,(z) and R,(z), respectively, 


then 
&lr (AT) + r(kT)] = R,(z) + R22) (2-186) 
2. Multiplication by a Constant 
glar(kT)) = ag[r(kT)) = aR(z) (2-187) 


where a is a constant. 
3. Real Translation 


§l[r(kT — nT)] = z-*R(z) (2-188) 
and 


gir(kT + nT) = | R@) -¥ rkT)z* | (2-189) 


where nx is a positive integer. Equation (2-188) represents the z- 
transform of a time sequence that is shifted to the right by n7, and 
Eq. (2-189) denotes that of a time sequence shifted to the left by nT. 
The reason the right-hand side of Eq. (2-189) is not z*R(z) is because 
the z-transform, similar to the Laplace transform, is defined only for 
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k > 0. Thus, the second term on the ri ght-hand side of Eq. (2-189) 
simply represents the sequence that is lost after it is shifted to the 


left by nT. 
4. Complex Translation 
gleF*?r(kT)] = R(ze**”) (2-190) 
5. Initial-Value Theorem 
lim r(kT) = lim R(z) (2-191) 


if the limit exists. 
6. Final-Value Theorem 
lim r(kT) = lim (1 — z71)R(z) (2-192) 
k0 $251 


if the function, (1 — z~!)R(z), has no poles on or outside the unit 
circle centered at the origin in the z-plane, |z| = 1. 


The following examples illustrate the usefulness of these theorems. 


EXAMPLE 2-20 Apply the complex translation theorem to find the z-transform of 
f(t) = te", t> 0. 
Let r(t) = t, t > 0; then 


RG) = glu) = 8KT) = ps (2-193) 

Using the complex translation theorem, 
= = = ay a2 dee 
F(z) = glte~*u,(t)] = R(ze*?) = Ga erp (2-194) 
EXAMPLE 2-21 Given the function 
0.79222 

R@) = Go De? — 0.4162 + 0.208) (2-195) 

determine the value of r(kT) as k approaches infinity. 
Since 
2 = 0.792z 
(1 — 2°) R@) = 3—Paloz + 0.208 (2-196) 


does not have any pole on or outside the unit circle |z| = 1 in the z-plane, the final- 
value theorem of the z-transform can be applied. Hence, 


. mee 0.792z _ 
lim r(kT) = lim 5—9 at6z 0.208 | Gi) 
This result is easily checked by expanding R(z) in powers of 27," 
R(z) = 0.792271 + 1.121272 4+ 1.091277 + 1.013274 +- 0.986275 
(2-198) 


+ 0.98127 + 0.998277 +... 


It is apparent that the coefficients of this power series converge rapidly to the final 
value of unity. 
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PROBLEMS 
2.1. Find the poles and zeros of the following functions (include the ones at infinity): 
2 S(s + 1) 
©) GO = BEDS $5) 
2, 
(b) Gs) = + D 


(s + 2)(s? + 35 + 2) 
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_ —K(s +2) 

(c) G(s) = ste) 

Ke- 2s 
(s + 1)(s + 2) 

2.2. Find the Laplace transforms of the following functions: 
(a) g(t) = te~## 
(b) g(t) = t cos St 
(c) g(t) = et sina@t 


(d) g(t) => e(kT)S(t — kT); 6(t) = unit impulse function 


(d) G(s) = 


2.3. Find the Laplace transforms of the functions shown in Fig. P2-3. 


(b) 
Figure P2-3. 


2.4. Find the Laplace transform of the following function: 


0 t<1 
t+1 1<t<3 
uo= 
S(t) 4 | 
0 4<t 
2.5. Solve the following differential equation by means of the Laplace transforma- 


tion: 


PIO + 5OO + apc) = cust) 


Assume that all the initial conditions are zero. 


2.6. Find the inverse pga transforms of the following functions: 
@) OO = GF NF 3) 


©) 68) = FETED 
10 

©) O9) = a Fae + D 
1 
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2.7. Carry out the following matrix sums and differences: 


"To —si+L-s sol 


(b) 7 15 20 
Sp ee 
3 5 
(<) 4 0 s+1] fo 10 —s 
+ 
5 ] s2 Ss i 0 
s—3 Ry 


2.8. Determine if the following matrices are conformable for the products AB and 
BA. Find the valid products. 


(a) 1 
A=! 0 B=[6 0 J 
3 


Med it ag 


2.9. Express the following set of algebraic equations in matrix form: 
5x, +x2—x3=1 
—X1 + 3x2 —x3 =1 
3x; — 7x2 — 2x3 =0 
2.10. Express the following set of differential equations in the form x(t) = Ax(f) 
+ Bu(t): 
X(t) = —x,(t) + x2(t) 
X2(t) = —2x2(t) — 3x3(t) + u(t) 
¥3(t) = —x,(t) — Sx2(t) — 3x3(t) + u(t) 
2.11. Find the inverse of the following matrices: 


(a) ee , 2 | 
L101 
(b) r 3 0 -1 
A=|-—2 1 2 
Loi -1 
(c) 1 3 4 
A=/|-1 1 0 
i-1 0 —1 
2.12. Determine the ranks of the following matrices: 
(a) [3 2 


7 
0 


1 

3 
(b) [2 4 0 8 
eon 
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2.13. 


2.14, 


2.15. 


2.16. 


Determine the definiteness of the following matrices: 
(a) 2 3 
Eel 
(b) 15 -1 
—2 0 0 


3 1 1 


The following signals are sampled by an ideal sampler with a sampling period 
of T seconds. Determine the output of the sampler, f*(r), and find the Laplace 
transform of f*(rt), F*(s). Express F*(s) in closed form. 

(a) f(t) = tea 

(b) f(t) = e-* sin wt 

Determine the z-transform of the following functions: 


@ 60) = ts 


7 1 
(c) Gs) = ss +2) 
(d) g(t) = t2e7% 
(e) g(t) = tsin at 
Find the inverse z-transform of 

10z(z + 1) 

(z— D@? +2441) 
by means of the following methods: 


(a) the inversion formula 
(b) partial-fraction expansion 


G(z) = 


3 


Transfer Function and 


Signal Flow Graphs 


3.1 Introduction 


One of the most important steps in the analysis of a physical system is the 
mathematical description and modeling of the system. A mathematical model 
of a system is essential because it allows one to gain a clear understanding of 
the system in terms of cause-and-effect relationships among the system com- 
ponents. 

In general, a physical system can be Tepresented by a schematic diagram 
that portrays the relationships and interconnections among the system com- 
ponents. From the mathematical standpoint, algebraic and differential or 
difference equations can be used to describe the dynamic behavior of a system. 

In systems theory, the block diagram is often used to portray systems of 
all types. For linear systems, transfer functions and signal flow graphs are 
valuable tools for analysis as well as for design. 

In this chapter we give the definition of transfer function of a linear system, 
and demonstrate the power of the signal-flow-graph technique in the analysis 
of linear systems. 


3.2. Transfer Functions of Linear Systems 


Transfer function plays an important role in the characterization of linear 
time-invariant systems. Together with block diagram and signal flow graph, 
transfer function forms the basis of representing the input-output relationships 
of a linear time-invariant system in classical control theory. 

The starting point of defining the transfer function is the differential equa- 
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tion of a dynamic system. Consider that a linear time-invariant system is 
described by the following nth-order differential equation: 
a’c(t) ila 1e(t) 
00 at" dt"! 
m-i1 
ihe a oi yard ores eeu + br(t) 
where c(t) is the output variable and r(r) is the input variable. The coefficients, 
Qo, 4;,...,4, and bo, by,..., 5, are constants, and n > m. 

The differential equation in Eq. (3-1) represents a complete description of 
the system between the input r(t) and the output c(t). Once the input and the 
initial conditions of the system are specified, the output response may be 
obtained by solving Eq. (3-1). However, it is apparent that the differential 
equation method of describing a system is, although essential, a rather cum- 
bersome one, and the higher-order differential equation of Eq. (3-1) is of little 
practical use in design. More important is the fact that although efficient sub- 
routines are available on digital computers for the solution of high-order 
differential equations, the important development in linear control theory relies 
on analysis and design techniques without actual solutions of the system differ- 
ential equations. 

A convenient way of describing linear systems is made possible by the use 
of transfer function and impulse response. To obtain the transfer function of the 
linear system that is represented by Eq. (3-1), we take the Laplace transform on 
both sides of the equation, and assuming zero initial conditions, we have 


(aos" + ays" ' +... + 4,15 + a,)C(s) 
= (bys™ + Bys™ 2 +... 4+ byys + by)R(8) 


The transfer function of the system is defined as the ratio of C(s) to R(s); 
therefore, 


+a +...+4 


(3-1) 


(3-2) 


_ C15) _ bs + bys +t by t by 
cali Rs) ag" F ays +... ais i ay oe) 


Summarizing over the properties of a transfer function we state: 


1. A transfer function is defined only for a linear system, and, strictly, 
only for time-invariant systems. 

2. Atransfer function between an input variable and an output variable 
of a system is defined as the ratio of the Laplace transform of the 
output to the Laplace transform of the input. 

3. All initial conditions of the system are assumed to be zero. 

4. A transfer function is independent of input excitation. 


The following example is given to illustrate how transfer functions for a 
linear system are derived. 


EXAMPLE 3-1. A series RLC network is shown in Fig. 3-1. The input voltage is 
designated by e,(t). The output variable in this case can be defined as 
the voltage across any one of the three network elements, or the current 


e;(t) 


Fig. 3-1. RLC network. 
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L i(t). The loop equation of the network is written 
+ Bs dif) , 1 ]{. : 
e,(t) = Ri(t) + La + C it) dt (3-4) 
i(t) C e.(t) Taking the Laplace transform on both sides of Eq. (3-4) 
. and assuming zero initial conditions, we have 
1 
- E(s) =(R+Ls + AO) (3-5) 


If we regard the current i(r) as an output variable, the transfer 

function between e,(t) and i(t) is simply 
Is) 1 a Cs 
Es)” R+Ls + (i/Cs)~ T+ RCs - LCs? 
If the voltage across the capacitor e-(t) is considered as an output, the transfer function 
between e,(t) and e,(t) is obtained by substituting 


(3-6) 


1 
EAs) = Us) (3-7) 
into Eq. (3-5). Therefore, 


EAs) __ 1 


E,(s) ~ D+ RCs FLO G-8) 


The definition of transfer function is easily extended to a system with a 
multiple number of inputs and outputs. A system of this type is often referred 
to as a multivariable system. In a multivariable system, a differential equation 
of the form of Eq. (3-1) may be used to describe the relationship between a pair 
of input and output. When dealing with the relationship between one input and 
one output, it is assumed that all other inputs are set to zero. Since the principle 
of superposition is valid for linear systems, the total effect on any output variable 
due to all the inputs acting simultaneously can be obtained by adding the 
individual effects. 

As a simple illustrative example of the transfer functions of a multivariable 
system, let us consider the control of a turbopropeller engine. In this case the 
input variables are the fuel rate and the propeller blade angle. The output 
variables are the speed of rotation of the engine and the turbine-inlet tempera- 
ture. In general, either one of the outputs is affected by the changes in both 
inputs. For instance, when the blade angle of the propeller is increased, the 
speed of rotation of the engine will decrease and the temperature usually 
increases. The following transfer relations may be written from steady-state 
tests performed on the system: 

C,(s) = G,,(s)R,(s) + G,,(s)R,(s) (3-9) 
C,(s) = G2,(s)R,(s) + G22(s)R2(s) (3-10) 
where 
C,(s) = transformed variable of speed of rotation 
C,(s) = transformed variable of turbine-inlet temperature 
R,(s) = transformed variable of fuel rate 
R,(s) = transformed variable of propeller blade angle 


All these variables are assumed to be measured from some reference levels. 
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Since Eqs. (3-9) and (3-10) are written with the assumption that the system 
is linear, the principle of superposition holds. Therefore, G,,(s) represents the 
transfer function between the fuel rate and the speed of rotation of the engine 
with the propeller blade angle held at the reference value; that is, R,(s) = 0. 
Similar statements can be made for the other transfer functions. 

In general, if a linear system has p inputs and q outputs, the transfer func- 
tion between the ith output and the jth input is defined as 


Cis) 
R,(s) 


with R,(s) = 0, k = 1,2,...,p, k Aj. Note that Eq. (3-11) is defined with 
only the jth input in effect, while the other inputs are set to zero. The ith output 
transform of the system is related to all the input transforms by 


Cis) = Gi(s)Ri(s) + G(s) R2(s) +... + G,,(s)R,(s) 


G(s) = (3-11) 


P ; (3-12) 
= >» G,,(s)R,(s) (i — 1, 2, eres | q) 
where G,,(s) is defined in Eq. (3-11). 
It is convenient to represent Eq. (3-12) by a matrix equation 
C(s) = G(s)R(s) (3-13) 
where 
C,(s) 
C,(s) 
Cis)=| ° (3-14) 
CAs) 
is ag X 1 matrix, called the transformed output vector; 
R,(s) 
R,(s) 
R(s) = : (3-15) 
R,(s) 
isa p X 1 matrix, called the transformed input vector; 
Gii(s) G,(s) ... ae 
Gri(s) G2(s) ... G2,(5) | 
G(s) = | (3-16) 
Gals) Gals) ... Gap(s)_| 


is aq X p matrix, called the transfer function matrix. 
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3.3. Impulse Response of Linear Systems 


The impulse response of a linear system is defined as the output response of the 
system when the input is a unit impulse function. Therefore, for a system with 
a single input and a single output, if r(t) = 6(0), the Laplace transform of the 
system output is simply the transfer function of the system, that is, 


C(s) = Gs) (3-17) 


since the Laplace transform of the unit impulse function is unity. 
Taking the inverse Laplace transform on both sides of Eq. (3-17) yields 
c(t) = g() (3-18) 
where g(t) is the inverse Laplace transform of G(s) and is the impulse response 
(sometimes also called the weighing function) of a linear system. Therefore, we 
can State that the Laplace transform of the impulse response is the transfer function. 
Since the transfer function is a powerful way of characterizing linear systems, 
this means that if a linear system has zero initial conditions, theoretically, the 
system can be described or identified by exciting it with a unit impulse response 
and measuring the output. In practice, although a true impulse cannot be 
generated physically, a pulse with a very narrow pulsewidth usually provides 
a suitable approximation. 
For a multivariable system, an impulse response matrix must be defined and 
is given by 
a(t) = £[G(s)] (3-19) 


where the inverse Laplace transform of G(s) implies the transform operation 
on each term of the matrix. 

The derivation of G(s) in Eq. (3-3) is based on the knowledge of the system 
differential equation, and the solution of C(s) from Eq. (3-3) also assumes that 
R(s) and G(s) are all available in analytical forms. This is not always possible, 
for quite often the input signal r(t) is not Laplace transformable or is available 
only in the form of experimental data. Under such conditions, to analyze the 
system we would have to work with the time function r(t) and g(2). 

Let us consider that the input signal r(z) shown in Fig. 3-2(a) is applied to a 
linear system whose impulse response is g(r). The output response c(t) is to be 
determined. In this case we have denoted the input signal as a function of r, 
which is the time variable; this is necessary since ¢ is reserved as a fixed time 
quantity in the analysis. For all practical purposes, r(t) is assumed to extend 
from minus infinity to plus infinity in time. 

Now consider that the input r(t) is approximated by a sequence of pulses 
of pulsewidth Az, as shown in Fig. 3-2(b). In the limit, as At approaches zero, 
these pulses become impulses, and the impulse at time kAr has a strength or 
area equal to At-r(kAt), which is the area of the pulse at kKAt. Also, when At 
decreases, k has to be increased proportionally, so the value of kAr remains 
constant and equals t, which is a particular point on the time axis. We now 
compute the output response of the linear system, using the impulse-approxi- 
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r(kAr) 


r(r) 


vad Le teas 


Ar 


(b) 


Fig. 3-2. (a) Input signal of a linear system. (b) Input signal represented by 
sum of rectangular pulses. 


mated signal. When only the impulse at time t = kAr is considered, the system 
response is given by 
At-r(kAt)g(t — kAt) (3-20) 


which is the system impulse response delayed by kAt, multiplied by the impulse 
strength At-r(kAt). By use of the superposition principle, the total response 
due to r(r) is obtained by adding up the responses due to each of the impulses 
from —co to +-oo. Therefore, 


c(t) = lim a2 r(kAt)g(t — kAt) At (3-21) 
or ™ 
c(t) = f = r(a)g(t — t) dt (3-22) 


For all physical systems, output response does not precede excitation. Thus 
a(t) =90 (3-23) 
for t < 0, since the impulse function is applied at f = 0. Or 


g(t—t)=0 t<t (3-24) 
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The output response of the system is now written 


e(t) = { c r(t)g(t — t) dt (3-25) 
Further, if r(t) = 0 for t < 0, Eq. (3-25) becomes 
c(t) = f ; r(t)e(t — 1) dt (3-26) 


The expressions of Eqs. (3-25) and (3-26) are called the convolution integral, 
The convolution operation is denoted by the symbol «, so 


c(t) = r(t) * g(t) (3-27) 
is interpreted as 
c(t) = r(t) convolves into a(t) (3-28) 


The positions of r(t) and g(t) in the convolution operation may be inter- 
changed, since basically there is no difference between the two functions. There- 
fore, the convolution integral can also be written as 


c(t) = f g(t)r(t — t) dt 


= g(t) * r(t) 
= g(t) convolves into r(z) 


(3-29) 


The evaluation of the impulse response of a linear system is sometimes an 
important step in the analysis and design of a class of systems known as the 
adaptive control systems. In real life the dynamic characteristics of most systems 
vary to some extent over an extended period of time. This may be caused by 
simple deterioration of components due to wear and tear, drift in operating 
environments, and the like. Some systems simply have parameters that vary 
with time in a predictable or unpredictable fashion. For instance, the transfer 
characteristic of a guided missile in flight will vary in time because of the change 
of mass of the missile and the change of atmospheric conditions. On the other 
hand, for a simple mechanical system with mass and friction, the latter may be 
subject to unpredictable variation either due to “aging” or surface conditions. 
Thus the control system designed under the assumption of known and fixed 
parameters may fail to yield satisfactory Tesponse should the system parameters 
vary. In order that the system may have the ability of self-correction or self- 
adjustment in accordance with varying parameters and environment, it is 
necessary that the system’s transfer characteristics be identified continuously or 
at appropriate intervals during the operation of the system. One of the methods 
of identification is to measure the impulse response of the system so that design 
parameters may be adjusted accordingly to attain Optimal control at all times. 

In the two preceding sections, definitions of transfer function and impulse 
response of a linear system have been presented. The two functions are directly 
related through the Laplace transformation, and they represent essentially the 
same information about the system. However, it must be reiterated that transfer 
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function and impulse response are defined only for linear systems and that the 
initial conditions are assumed to be zero. 


3.4 Block Diagrams! 


Inlet 
pressure 


Control 


valve 


Because of its simplicity and versatility, block diagram is often used by control 
engineers to portray systems of all types. A block diagram can be used simply to 
represent the composition and interconnection of a system. Or, it can be used, 
together with transfer functions, to represent the cause-and-effect relationships 
throughout the system. For instance, the block diagram of Fig. 3-3 represents a 
turbine-driven hydraulic power system for an aircraft. The main components of 
the system include a pressure-compensated hydraulic pump, an air-driven pump, 
an electronic speed controller, and a control valve. The block diagram in the 
figure depicts how these components are interconnected. 


Current 
Controller 


Turbine 
torque 


Output 


Hydraulic 
pump 


Pump torque 


Load flow 


Fig. 3-3. Block diagram of a turbine-driven hydraulic power system. 


If the mathematical and functional relationships of all the system elements 
are known, the block diagram can be used as a reference for the analytical or the 
computer solution of the system. Furthermore, if all the system elements are 
assumed to be linear, the transfer function for the overall system can be obtained 
by means of block-diagram algebra. 

The essential point is that block diagram can be used to portray nonlinear 
as well as linear systems. For example, Fig. 3-4(a) shows the block diagram 
of a simple control system which includes an amplifier and a motor. In the 
figure the nonlinear characteristic of the amplifier is depicted by its nonlinear 


Sec. 3.4 Block Diagrams / 59 


S(s ta) 


(a) 


Km 
s(s +a) 


(b) 


Fig. 3-4. Block diagram of a simple control system. (a) Amplifier shown 
with a nonlinear gain characteristic. (b) Amplifier shown with a linear gain 
characteristic. 


input-output relation. The motor is assumed to be linear and its dynamics are 
represented by a transfer function between the input voltage and the output 
displacement. Figure 3-4(b) illustrates the same system but with the amplifier 
characteristic approximated by a constant gain. In this case the overall system 
is linear, and it is now possible to write the transfer function for the overall 
system as 

Hs) _ Os) Ens) _KKy (3-30) 

Es) ~ E,(s) Es) ~ s(s + a) 


Block Diagrams of Control Systems 


We shall now define some block-diagram elements used frequently in con- 
trol systems and the block-diagram algebra. One of the important components 
of a feedback control system is the sensing device that acts as a junction point 
for signal comparisons. The physical components involved are the potenti- 
ometer, synchros, resolvers, differential amplifiers, multipliers, and so on. In 
general, the operations of the sensing devices are addition, subtraction, mul- 
tiplication, and sometimes combinations of these. The block-diagram elements 
of these operations are illustrated as shown in Fig. 3-5. It should be pointed out 
that the signals shown in the diagram of Fig. 3-5 can be functions of time t or 
functions of the Laplace transform variable s. 

In Fig. 3-4 we have already used block-diagram elements to represent input— 
output relationships of linear and nonlinear elements. It simply shows that the 
block-diagram notation can be used to tepresent practically any input-output 
relation as long as the relation is defined. For instance, the block diagram of 
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“ 


r 
e=r-—c e=rtec 
+ 
c c 
(a) Subtraction (b) Addition 
" 
Y r 
e=r, try —¢ e=rc 
: c 
(c) Addition and subtraction (d) Multiplication 


Fig. 3-5. Block-diagram elements of typical sensing devices of control 
systems. (a) Subtraction. (b) Addition. (c) Addition and subtraction. (d) 


Multiplication. 
u(t) : 
= = = ei = 
(a) (b) (c) 


Fig. 3-6. Block-diagram representations of input-output relationships of 
systems, 


Fig. 3-6(a) represents a system that is described by the linear differential equa- 
tion 
x(t) = ax(t) + bu(t) (3-31) 
Figure 3-6(b) illustrates the input-output relation of a system described by the 
vector-matrix differential equation 
X() = f[x(), u] (3-32) 


where x() is ann X 1 vector and u(t) is an Xx 1 vector. As another example, 
Fig. 3-6(c) shows a block diagram which represents the transfer function of a 
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linear system; that is, 
C(s) = G(s)R(s) (3-33) 
where G(s) is the transfer function. 

Figure 3-7 shows the block diagram of a linear feedback control system. 
The following terminology often used in control systems is defined with reference 
to the block diagram: 

r(t), R(s) = reference input 

c(t), C(s) = output signal (controlled variable) 
5(t), B(s) = feedback signal 

e(t), &(s) = actuating signal 

e(t), E(s) = R(s) — C(s) = error signal 


G(s) = os) = open-loop transfer function or forward- 


Bs) path transfer function 
Ms) = mo = closed-loop transfer function 


H(s) = feedback-path transfer function 
G(s)H(s) = loop transfer function 


The closed-loop transfer function, M(s) = C(s)/R(s), can be expressed as 
a function of G(s) and H(s). From Fig. 3-7 we write 


C(s) = G(s)&(s) (3-34) 
and 
B(s) = H(s)C(s) (3-35) 
The actuating signal is written 
&(s) = R(s) — B(s) (3-36) 
Substituting Eq. (3-36) into Eq. (3-34) yields 
C(s) = G(s)R(s) — G(s)B(s) (3-37) 
Substituting Eq. (3-35) into Eq. (3-37) gives 
C(s) = G(s)R(s) ~ G(s)H(s)C(s) (3-38) 


Solving C(s) from the last equation, the closed-loop transfer function of the 


Fig. 3-7. Basic block diagram of a feedback control system. 
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system is given by 
_ C(s) _ G(s) ‘ 

we R(s)” 1 + G(s)H(s) oe) 
In general, a practical control system may contain many feedback loops, and. 
the evaluation of the transfer function from the block diagram by means of the 
algebraic method described above may be tedious. In principle at least, the 
block diagram of a system with one input and one output can always be reduced 
to the basic single-loop form of Fig. 3-7. However, the steps involved in the 
reduction process may again be quite involved. We shall show later that the 
transfer function of any linear system can be obtained directly from its block 
diagram by use of the signal-flow-graph gain formula. 


Block Diagram and Transfer Function of Multivariable Systems 


A multivariable system is defined as one that has a multiple number of 
inputs and outputs. Two block-diagram representations of a multiple-variable 
system with p inputs and g outputs are shown in Fig. 3-8(a) and (b). In Fig. 
3-8(a) the individual input and output signals are designated, whereas in the 
block diagram of Fig. 3-8(b), the multiplicity of the inputs and outputs is 
denoted by vectors. The case of Fig. 3-8(b) is preferable in practice because of its 


simplicity. 
ryt) ef) 
r,(t) Cy (t) 
Multivariable 
system 
rp) Cq(t) 
(a) 
Multivariable 
r(¢) system c(t) 
(b) 


Fig. 3-8. Block-diagram representations of a multivariable system. 


Figure 3-9 shows the block diagram of a multivariable feedback control 
system. The transfer function relationship between the input and the output of 
the system is obtained by using matrix algebra: 

C(s) = G(s)&(s) (3-40) 
&(s) = R(s) — Bos) (3-41) 
Bis) = H(s)C(s) (3-42) 
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Fig. 3-9. Block diagram of a multivariable feedback control system. 


Substituting Eq. (3-42) into Eq. (3-41) and then from Eq. (3-41) into Eq. (3-40) 
yields 


C(s) = G(s)R(s) — G(s)H(s)C(s) (3-43) 
Solving for C(s) from Eq. (3-43) gives 
C(s) = [I + G(s)H(s)]-'G(s)R(s) (3-44) 


provided that I + G(s)H(s) is nonsingular. 

It should be mentioned that although the development of the input-output 
relationship here is similar to that of the single input-output case, in the present 
situation it is improper to speak of the ratio C(s)/R(s) since C(s) and R(s) are 
matrices. However, it is still possible to define the closed-loop transfer matrix as 


M(s) = [I + G(s)H(s)]"' G(s) (3-45) 
Then Eq. (3-44) is written 
C(s) = M(s)R(s) (3-46) 


EXAMPLE 3-2 Consider that the forward-path transfer function matrix and the 
feedback-path transfer function matrix of the system shown in Fig. 


3-9 are 
ie Serer, © 
+1 
Go) =|° se (3-47) 
2 s+2 
and 
HG) k ; 
"lo 1 
respectively. 


The closed-loop transfer matrix of the system is given by Eq. (3-45) and is evalu- 
ated as follows: 


I + G(s)H(s) = = (3-48) 
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The closed-loop transfer matrix is 


+3 1 1 1 
F2 8 |is+i os 
M(s) = [+ G()H()}-6G) = 4° eS 5 (3-49) 
A 2 3 +2 7 1 
s+1 a s+2 
where 
~S+2s+3 2 _ st+584+2 : 
earns Ceo ir s(s + 1) (3-50) 
Thus 
3s? + 95 +4 ll: 
sis +1) [ss + Is + 2) 5 
MG) = ps2 ee (3-51) 
2 ee 
s(s sf 1) 


3.5 Signal Flow Graphs? 


A signal flow graph may be regarded as a simplified notation for a block dia- 
gram, although it was originally introduced by S. J. Mason* as a cause-and-effect 
representation of linear systems. In general, besides the difference in the physical 
appearances of the signal flow graph and the block diagram, we may regard 
the signal flow graph to be constrained by more rigid mathematical relationships, 
whereas the rules of using the block-diagram notation are far more flexible and 
less stringent. 

A signal flow graph may be defined as a graphical means of portraying the 
input-output relationships between the variables of a set of linear algebraic 
equations. 

Consider that a linear system is described by the set of V algebraic equations 

N 


= 2 Ani Ve feds 2yee iy NV (3-52) 


It should be pointed out that these N equations are written in the form of cause- 
and-effect relations: 


jth effect = 3° (gain from k to j)(kth cause) (3-53) 
k=1 


or simply 
output = 5} (gain)(input) (3-54) 


This is the single most important axiom in the construction of the set of algebriac 
equations from which a signal flow graph is drawn. 

In the case when a system is represented by a set of integrodifferential 
equations, we must first transform them into Laplace transform equations and 
then rearrange the latter into the form of Eq. (3-52), or 


Y,(s) = > GA9YAs) f=l...,N (3-55) 


When constructing a signal flow graph, junction points or nodes are used 
to represent the variables y, and y,. The nodes are connected together by line 
segments called branches, according to the cause-and-effect equations. The 
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branches have associated branch gains and directions. A signal can transmit 
through a branch only in the direction of the arrow. In general, given a set of 
equations such as those of Eq. (3-52) or Eq. (3-55), the construction of the 
signal flow graph is basically a matter of following through the cause-and- 
effect relations relating each variable in terms of itself and the other variables. 
For instance, consider that a linear system is represented by the simple equation 


Yn = M2), (3-56) 


where y, is the input variable, y, the output variable, and a,, the gain or trans- 
mittance between the two variables. The signal-flow-graph representation of 
Eq. (3-56) is shown in Fig. 3-10. Notice that the branch 

a1 directing from node y, to node J2 expresses the depend- 


ra cence'of y, upon y,. It should be reiterated that Eq. (3-56) 


Vy 


Fig. 3-10. 
== A121. 


¥2 and Fig. 3-10 represent only the dependence of the out- 


put variable upon the input variable, not the reverse. 
An important consideration in the application of signal 
flow graphs is that the branch between the two nodes y, 
and y, should be integrated as a unilateral amplifier with gain @,,, so that when 
a signal of one unit is applied at the input y,, the signal is multiplied by a,, and 
a signal of strength a,, is delivered at node Y2. Although algebraically Eq. (3-56) 
can be rewritten 


Signal flow graph of y2 


1 
YA a2)” (3-57) 


the signal flow graph of Fig. 3-10 does not imply this relationship. If Eq. (3-57) 
is valid as a cause-and-effect equation in the physical sense, a new signal flow 
graph must be drawn. 

As another illustrative example, consider the following set of algebraic 
equations: 


Ya = Qi2V1 + Agr 
V3 = An3 V2 + Aga 
Va = Gg V2 + A343 + gg Vo 
Vs = Ars V2 + Ags Ya 


(3-58) 


The signal flow graph for these equations is constructed step by step as shown 
in Fig. 3-11, although the indicated sequence of steps is not unique. The nodes 
representing the variables y,, y., y3, v4, and ys are located in order from left to 
right. The first equation states that ¥2 depends upon two signals, 412), and 
@32)3; the signal flow graph representing this equation is drawn as shown in 
Fig. 3-11(a). The second equation states that y, depends upon a@,3y, and agsy,; 
therefore, on the signal flow graph of Fig. 3-11(a), a branch of gain a,, is drawn 
from node y, to y;, and a branch of gain a,, is drawn from ys to y; with the 
directions of the branches indicated by the arrows, as shown in Fig. 3-11(b). 
Similarly, with the consideration of the third equation, Fig. 3-11(c) is obtained. 
Finally, when the last equation of Eq. (3-58) is portrayed, the complete signal 
flow graph is shown in Fig. 3-11(d). The branch that begins from the node Vs 
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439 
412 
re) fo) 
al y2 ¥3 V4 Vs 
(a) ¥2 = 2¥1 + 43243 
a32 943 
12 fs 
© O O © fe) 
yy y2 V3 Ya Vs 


(b) ¥2 =ay2V1 +43273,43 =G23¥2 + 443¥4 


45 


(d) Complete signal flow graph 


Fig. 3-11. Step-by-step construction of the signal flow graph for Eq. 
(3-58). (a) Y2 = a12¥1 + a32¥3. (b) yo = G12¥1 + 432¥3, V3 == a23y2 
+ a4zya. (C) 2 = 4121 + 43293, ¥3 = A23¥2 + Gazya, Va = A24y2 
+ a34y3 + aagya. (d) Complete signal flow graph. 


and ends at y, is called a loop, and with a gain a,,, represents the dependence 
of y, upon itself. 


3.6 Summary of Basic Properties of Signal Flow Graphs 


At this point it is best to summarize some of the important properties of the 
signal flow graph. 


1. A signal flow graph applies only to linear systems. 

2. The equations based on which a signal flow graph is drawn must be 
algebraic equations in the form of effects as functions of causes. 

3. Nodes are used to represent variables. Normally, the nodes are 
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arranged from left to right, following a succession of causes and 
effects through the system. 

4. Signals travel along branches only in the direction described by the 
arrows of the branches. 

5. The branch directing from node yx tO y; represents the dependence 
of the variable y, upon y,, but not the reverse. 

6. A signal y, traveling along a branch between nodes yy, and y, is 
multiplied by the gain of the branch, a,,, so that a signal an jx is 
delivered at node y,. 


3.7 Definitions for Signal Flow Graphs 


In addition to the branches and nodes defined earlier for the signal flow graph, 
the following terms are useful for the purposes of identification and reference. 


Input node (source). An input node is a node that has only outgoing 
branches. (Example: node y, in Fig. 3-11.) 


Output node (sink). An output node is a node which has only incoming 
branches. (Example: node y, in Fig. 3-11.) However, this condition is not always 
readily met by an output node. For instance, the signal flow graph shown in 
Fig. 3-12(a) does not have any node that satisfies the condition of an output 
node. However, it may be necessary to regard nodes y, and/or y, as output 
nodes. In order to meet the definition requirement, we may simply introduce 
branches with unity gains and additional variables y, and y,, as shown in Fig. 
3-12(b). Notice that in the modified signal flow graph it is equivalent that the 


412 423 


(b) Modified signa! flow graph 


Fig. 3-12. Modification of a signal flow graph so that y2 and 3 satisfy the 
requirement as output nodes, (a) Original signal flow graph. (b) Modified 
signal flow graph. 
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equations y, = y, and y,; = y; are added. In general, we can state that any 
noninput node of a signal flow graph can always be made an output node by 
the aforementioned operation. However, we cannot convert a noninput node 
into an input node by using a similar operation. For instance, node yz of the 
signal flow graph of Fig. 3-12(a) does not satisfy the definition of an input node. 
If we attempt to convert it into an input node by adding an incoming branch of 
unity gain from another identical node y,, the signal flow graph of Fig. 3-13 
would result. However, the equation that portrays the relationship at node y, 
now reads 

Vo = V2 + Gyayi + Aa2y3 (3-59) 


which is different from the original equation, as written from Fig. 3-12(a), 


V2 = A121 + A32y3 (3-60) 


~ 432 
432 412 


Fig. 3-13. Erroneous way to make the node y2 Fig. 3-14. Signal flow graph with y2 as an input 
an input node. node. 


Since the only proper way that a signal flow graph can be drawn is from a 
set of cause-and-effect equations, that is, with the causes on the right side of the 
equation and the effects on the left side of the equation, we must transfer y, 
to the right side of Eq. (3-60) if it were to be an input. Rearranging Eq. (3-60), 
the two equations originally for the signal flow graph of Fig. 3-12 now become 


Hoey wt; (3-61) 
12 2 


Va = Q23)2 (3-62) 


The signal flow graph for these two equations is shown in Fig. 3-14, with y, 
as an input node. 


Path. A path is any collection of continuous succession of branches 
traversed in the same direction. The definition of a path is entirely general since 
it does not prevent any node to be traversed more than once. Therefore, as 
simple as the signal flow graph of Fig. 3-12(a) is, it may have numerous paths. 


Forward path. A forward path is a path that starts at an input node and 
ends at an output node and along which no node is traversed more than once. 
For example, in the signal flow graph of Fig. 3-11(d), y, is the input node, and 
there are four possible output nodes in y,, ys, Ys, and ys. The forward path 
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between y, and y, is simply the branch connected between y, and y,. There are 
two forward paths between y, and y;; one contains the branches from y, to yz 
to y3, and the other one contains the branches from y, to y, to y, (through the 
branch with gain a,,) and then back to y, (through the branch with gain a,;). 
The reader may determine the two forward paths between y, and y,. Similarly, 
there are also two forward paths between y, and y,. 


Loop. A loop is a path that originates and terminates on the same node 
and along which no other node is encountered more than once. For example, 
there are four loops in the signal flow graph of Fig. 3-11(d). These are shown 
in Fig. 3-15. 


me 743 44 
y2 a3 V3 O 

Jy: a 

3 34 Va V4 
439 a43 
v2 
v4 
24 


Fig. 3-15. Four loops in the signal flow graph of Fig. 3-11(d). 


Path gain. The product of the branch gains encountered in traversing a 
path is called the path gain. For example, the path gain for the path 
Vi — V2 — Ys — Yq in Fig. 3-11(d) is a, 2423054. 


Forward-path gain, Forward-path gain is defined as the path gain of a 
forward path. 


Loop gain. Loop gain is defined as the path gain of a loop. For example, 
the loop gain of the loop y, — ys — y3 — yz in Fig. 3-15 is a,4@4,@3. 


3.8 Signal-Flow-Graph Algebra 


Based on the properties of the signal flow graph, we can state the following 
manipulation and algebra of the signal flow graph. 


1. The value of the variable represented by a node is equal to the sum 
of all the signals entering the node. Therefore, for the signal flow 
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V6 yr 


Fig. 3-16. Node as a summing point and as a transmitting point. 


graph of Fig. 3-16, the value of y, is equal to the sum of the signals 
transmitted through all the incoming branches; that is, 


Vi = Qa: V2 + Azi1Y3 + Agi Ya Fb as1Vs (3-63) 


2. The value of the variable represented by a node is transmitted 
through all branches leaving the node. In the signal flow graph of 
Fig. 3-16, we have 


Vo = 4Qi6)1 
Yr = Ayr) (3-64) 
Me) Vs = Qrgyi 


3. Parallel branches in the same direction connected between two 
nodes can be replaced by a single branch with gain equal to the sum 
of the gains of the parallel branches. An example of this case is 
illustrated in Fig. 3-17. 


\ atbtc f 


v1 y2 


Fig. 3-17. Signal flow graph with parallel paths replaced by one with a 
single branch. 
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412 423 934 445 956 
Vi y2 V3 v4 Vs ¥6 
412473934445 456 
—>——————2 
Vi V6 


Fig. 3-18. Signal flow graph with cascaded unidirectional branches re- 
placed by a single branch. 


4. A series connection of unidirectional branches, as shown in Fig. 
3-18, can be replaced by a single branch with gain equal to the 
product of the branch gains. 

5. Signal flow graph of a feedback control system. Figure 3-19 shows 
the signal flow graph of a feedback control system whose block 
diagram is given in Fig. 3-7. Therefore, the signal flow graph may be 
regarded as a simplified notation for the block diagram. Writing the 
equations for the signals at the nodes &(s) and C(s), we have 


&(s) = R(s) — H(s)C(s) (3-65) 
and 

C(s) = G(s)&(s) (3-66) 
The closed-loop transfer function is obtained from these two 
equations, 

C(s) _ G(s) . 

RG) ~ TGA) ay 

1 G(s) 1 
R(s) &(s) N v C(s) Cs) 
— H(s) 


Fig. 3-19. Signal flow graph of a feedback control system. 


For complex signal flow graphs we do not need to rely on algebraic manipu- 
lation to determine the input-output relation. In Section 3.10 a general gain 
formula will be introduced which allows the determination of the gain between 
an input node and an output node by mere inspection. 


3.9 Examples of the Construction of Signal Flow Graphs 


It was emphasized earlier that the construction of a signal flow graph of a phys- 
ical system depends upon first writing the equations of the system in the cause- 
and-effect form. In this section we shall give two simple illustrative examples. 
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Owing to the lack of background on systems at this early stage, we are using two 
electric networks as examples. More elaborate cases will be discussed in Chapter 
5, where the modeling of systems is formally covered. 


EXAMPLE 3-3. The passive network shown in Fig. 3-20(a) is considered to consist of 
R, L, and C elements so that the network elements can be represented 
by impedance functions, Z(s), and admittance functions, Y(s). The 

Laplace transform of the input voltage is denoted by £;,(s) and that of the output 

voltage is £,(s). In this case it is more convenient to use the branch currents and node 

voltages designated as shown in Fig. 3-20(a). Then one set of independent equations 
representing cause-and-effect relation is 


1,(s) = [(E,(s) — £2(5)] Yi) (3-68) 

E,(s) = [1(s) — 13(8)]Z2(5) (3-69) 

1(s) = [ExG) — E.(s)] ¥s(s) (3-70) 

E,(s) = Z,(s)I3(s) (3-71) 
Y, (s) Y3(s) 


I3(s) 


2, (s) Z4 (s) 


(a) 


Y,() iG) Z,(s) E,(s) Y3(s) i(s) 2, (s) Eq(s) 1 


E,,(s) E,(s) 


aad Y,(s) = Z,(s) = Y3(s) 


Fig. 3-20. (a) Passive ladder network. (b) A signal flow graph for the net- 
work, 


With the variables E,,(s), 1,(s), £2(s), I3(s), and £,(s) arranged from left to right 
in order, the signal flow graph of the network is constructed as shown in Fig. 3-20(b). 

It is noteworthy that in the case of network analysis, the cause-and-effect equa- 
tions that are most convenient for the construction of a signal flow graph are neither the 
loop equations nor the node equations. Of course, this does not mean that we cannot 
construct a signal flow graph using the loop or the node equations. For instance, in 
Fig. 3-20(a), if we let 7,(s) and J;(s) be the loop currents of the two loops, the loop 
equations are 
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Einls) = [2Z1(s) + Z2(sMi(s) — Z2(s)J3(s) (3-72) 
0 = —Z,(s)Ii(s) + [Z2(s) + Z3(8) + Za()a(s) (3-73) 
E(s) = Z,4(s)13(s) (3-74) 


However, Eqs. (3-72) and (3-73) should be rearranged, since only effect variables can 
appear on the left-hand sides of the equations. Therefore, solving for J,(s) from Eq. 
(3-72) and I;(s) from Eq. (3-73), we get 


_ 1 Z,(s) 
I,(s) = Zisy + Dye) Hin’) + Zia + Zw) (3-75) 
Z,(s) (3-76) 


2) = ZF ZG) FL 


Now, Eqs. (3-74), (3-75), and (3-76) are in the form of cause-and-effect equations. The 
signal flow graph portraying these equations is drawn as shown in Fig. 3-21. This 
exercise also illustrates that the signal flow graph of a system is not unique. 


1 Z,(s) 
Z\()+Z)6) Zy,)+2;(3) + Za) Z,(s) 
Ein(s) I (s) I3(s) Ey(s) 
Z3(s) 


Z,(s) + Z,(s) 


Fig. 3-21. Signal flow graph of the network in Fig. 3-20(a) using the loop 
equations as a starting point. 


ExAmpLe 3-4 —_ Let _us consider the RLC network shown in Fig. 3-22(a). We shall 
define the current i(t) and the voltage e,(t) as the dependent variables 
of the network. Writing the voltage across the inductance and the 

current in the capacitor, we have the following differential equations: 


Gp = ei) ~ Ri) — elt) (3-77) 
c£O _ iw (3-78) 


However, we cannot construct a signal flow graph using these two equations since they 
are differential equations. In order to arrive at algebraic equations, we divide Eqs. 
(3-77) and (3-78) by L and C, respectively. When we take the Laplace transform, we 
have 


sl) = 10+) + PEO) — £1) ~1 Ey) (3-79) 


SEs) = 0+) + L1G) (3-80) 


where i(0+) is the initial current and e,(0+) is the initial voltage at t = 0+. In these 
last two equations, e,(0+), i (0+), and E,(s) are the input variables. There are several 
possible ways of constructing the signal flow graph for these equations. One way is to 
solve for I(s) from Eq. (3-79) and E.(s) from Eq. (3-80); we get 
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R L 
e, (t) C Re (t) 
(a) 
i(0 +) e.(0 +) 


I 
~ L(s+R/L) 
(b) 


—WL 
(c) 
Fig. 3-22. (a) RLC network. (b) Signal fiow graph. (c) Alternative signal 
flow graph. 
x 1 F 1 1 
19) =F RDO) + tap — sR OSD 
EAs) = Let) + GI) (3-82) 


The signal flow graph using the last equations is drawn as shown in Fig. 3-22(b). 

The signal flow graph in Fig. 3-22(b) is of analytical value only. In other words, 
we can solve for I(s) and £,(s) from the signal flow graph in terms of the inputs, e,(0+-), 
i(0-++), and E;(s), but the value of the signal flow graph would probably end here. As an 
alternative, we can use Eqs. (3-79) and (3-80) directly, and define /(s), E,(s), sI(s), and 
sE,(s) as the noninput variables. These four variables are related by the equations 
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I(s) = s~[sI(s)) (3-83) 
EAs) = s~ [sE.(s)] (3-84) 


The significance of using s~! is that it represents pure integration in the time domain. 
Now, a signal flow graph using Eqs. (3-79), (3-80), (3-83), and (3-84) is constructed as 
shown in Fig. 3-22(c). Notice that in this signal flow graph the Laplace transform 
variable appears only in the form of s~!. Therefore, this signal flow graph may be used 
as a basis for analog or digital computer solution of the problem. Signal flow graphs 
in this form are defined in Chapter 4 as the state diagrams.° 


3.10 General Gain Formula for Signal Flow Graphs? 


Given a signal flow graph or a block diagram, it is usually a tedious task to 
solve for its input-output relationships by analytical means. Fortunately, there 
is a general gain formula available which allows the determination of the input- 
output relationship of a signal flow graph by mere inspection. The general gain 
formula is 


M — Vout — y M, 1A (3-85) 
Yin K=1 
where 
M = gain between y,, and y,u, 
Your = output node variable 
Yin = input node variable 
N = total number of forward paths 
M, = gain of the kth forward path 
A= 1 = 5) Past SP — OP, (3-86) 


Pap = gain product of "the mth el combination of r 

nontouching* loops 
or 
A = | — (sum of all individual loop gains) + (sum of 

gain products of all possible combinations of two 
nontouching loops) — (sum of the gain products 
of all possible combinations of three nontouching (3-87) 
loops) +... 

A, = the A for that part of the signal flow graph which 
is nontouching with the kth forward path 


This general formula may seem formidable to use at first glance. However, 
the only complicated term in the gain formula is A; but in practice, systems 
having a large number of nontouching loops are rare. An error that is frequently 
made with regard to the gain formula is the condition under which it is valid. 
It must be emphasized that the gain formula can be applied only between an 
input node and an output node. 


*Two parts of a signal flow graph are said to be nontouching if they do not share a com- 
mon node, 
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EXAMPLE 3-5 Consider the signal flow graph of Fig. 3-19. We wish to find the 
transfer function C(s)/R(s) by use of the gain formula, Eq. (3-85). 
The following conclusions are obtained by inspection from the signal 
flow graph: 


1. There is only one forward path between R(s) and C(s), and the forward- 
path gain is 


M, = G(s) (3-88) 
2. There is only one loop; the loop gain is 
Py, = ~G(s)H(s) (3-89) 


3. There are no nontouching loops since there is only one loop. Further- 
more, the forward path is in touch with the only loop. Thus A; = 1, and 
A=1 —~Pi, = 1+ G(s)H(s). 


By use of Eq. (3-85), the transfer function of the system is obtained as 


C(s)_ Mi Ay _ G(s) 
R(s) A 14+ G(s)H(s) 


which agrees with the result obtained in Eq. (3-67). 


(3-90) 


EXAMPLE 3-6 Consider, in Fig. 3-20(b) that the functional relation between £,, and 
E, is to be determined by use of the general gain formula. The signal 
flow graph is redrawn in Fig. 3-23(a). The following conclusions 

are obtained by inspection from the signal flow graph: 


1. There is only one forward path between E,, and £,, as shown in Fig. 
3-23(b). The forward-path gain is 


M, = Y,Z2 Y3Z4 (3-91) 

2. There are three individual loops, as shown in Fig. 3-23(c); the loop gains 
are 

Pip = —-21Y (3-92) 

Py, = —22Y73 (3-93) 

P3, = —Z4Y3 (3-94) 


3. There is one pair of nontouching loops, as shown in Fig. 3-23(d); the loop 
gains of these two loops are 
—Z2,Y1 and —Z4Y3 
Thus 


Pi. = product of gains of the first (and only) possible (3-95) 
combination of two nontouching loops == 72,2471 Y3 


4. There are no three nontouching loops, four nontouching loops, and so 
on; thus 
Pin3 = 0, Pha =0,... 
From Eq. (3-86), 
A=1— (Pir + Pat + P31) + Pir 


is (3-96) 
H=14+ 2724+ 793+ 243 + 2.24N Ns 
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Y, q Z, EB, Y; I; Z4 Eo 1 Eo 
ah Cie ae “ae mae 
“XY 2, ay 
(a) 

Y, Z; Y; Z, 1 
Oo—_—>——_—_—_o Oo OO 
En h E, Is Ey Ep 
(b) 
Z, E, Y; hy Z Ey 
i ow ? 
-Y, ae -Y; 
(c) 
i 2, E, I; Z4 Eo 
= Y, = Y3 
(d) 


Fig. 3-23. (a) Signal flow graph of the passive network in Fig. 3-20(a). (b) 
Forward path between F;, and E,. (c) Three individual loops. (d) Two 
nontouching loops. 
5. All the three feedback loops are in touch with the forward path; thus 
A, =1 (3-97) 


Substituting the quantities in Eqs. (3-91) through (3-97) into Eq. (3-85), we obtain 


Eo = M, A, = Y; Y32224 
E; A 14-22:Y;+22Y3; + 24V3 + 2,241 Y3 


(3-98) 


EXAMPLE 3-7 —‘ Consider the signal flow graph of Fig. 3-22(c). It is desired to find the 
relationships between J and the three inputs, £;, (0+), and e.(0+). 
Similar relationship is desired for E,. Since the system is linear, the 
principle of superposition applies. The gain between one input and one output is deter- 
mined by applying the gain formula to the two variables while setting the rest of the 
inputs to zero. 
The signal flow graph is redrawn as shown in Fig. 3-24(a). Let us first consider J 
as the output variable. The forward paths between each inputs and J are shown in 
Fig. 3-24(b), (c), and (d), respectively. 
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— W/L 
1 
t ei (a) 
-->———_0——_>————0 
E, sl I 
(b) 
i(O +) 
1 
sl 
sf I 
(c) 


e,(0 +) 


—1/L 


(d) 


Fig. 3-24. (a) Signal flow graph of the RLC network in Fig. 3-22(a). (b) 
Forward path between £; and J. (c) Forward path between /(0+) and J. 
(d) Forward path between e,(0+) and J. 
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The signal flow graph has two loops; the A is given by 
=1,4+ Rein 1y, : 
A=1+-Fs + Té@s (3-99) 


All the forward paths are in touch with the two loops; thus A; = 1 for all cases. 
Considering each input separately, we have 


nade 
# = ee 0+) =0, e,(0+) =0 (3-100) 
1 
Ss Eo 0+) =0 3-101 
jon a 1 =0, e(0+) = (3-101) 
; oD = eee i0+)=0, £,=0 (3-102) 
When all three inputs are applied simultaneously, we write 
galls, 1; _1..2 | E 
rs AE! Ey + s+) — +5"e.0+4) (3-103) 


In a similar fashion, the reader should verify that when E, is considered as the 
output variable, we have 


LC 


Notice that the loop between the nodes s/ and J is not in touch with the forward path 
between e,(0+) and E,. 


B= 5] peste: + Ee MOd) + H(t + Es )e(O+)| — G-104) 


EXAMPLE 3-8 Consider the signal flow graph of Fig. 3-25. The following input- 
output relations are obtained by use of the general gain formula: 


y2 all +d)- 
—= s+ 3-105 
az A ( ) 
y3 _ ae(l+d)+ abe 
73 ye RE eet 3-106 
oF A ¢ ) 
where 
A=1+e¢+d+ beg 4+ deg (3-107) 
—d 


m4 


Fig. 3-25. Signal flow graph for Example 3-8. 
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3.11. Application of the General Gain Formula to Block Diagrams 


Because of the similarity between the block diagram and the signal flow graph, 
the general gain formula in Eq. (3-85) can be used to determine the input-output 
relationships of either. In general, given a block diagram of a linear system we 
can apply the gain formula directly to it. However, in order to be able to identify 
all the loops and nontouching parts clearly, sometimes it may be helpful if an 
equivalent signal flow graph is drawn for a block diagram before applying the 
gain formula. 

To illustrate how the signal flow graph and the block diagram are related, 
the equivalent models of a control system are shown in Fig. 3-26. Note that 
since a node on the signal flow graph is interpreted as a summing point of all 


(b) 


Fig. 3-26. (a) Block diagram of a control system. (b) Equivalent signal 
flow graph. 
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incoming signals to the node, the negative feedback paths in this case are 
represented by assigning negative gains to the feedback paths. 

The closed-loop transfer function of the system is obtained by applying 
Eq. (3-85) to either the block diagram or the signal flow graph: 


C(s) = G,G,G, + G,G, (3-108) 
R(s) 114 G,G,H, + G,G63,H, + G,G,G, + G,H, + GG, 
Similarly, 
E(s)__1+G,G,H, + G,G,H, + G,H, : 
Ro (3-109) 
Y,(s)_ 1+ G,G;H, + G,H, 2 
Rs)  ti(i<C A!” Ga) 
where 


A=1+G,G,H,; + G,G;H, + G,G,G;+ GH, + G,G, (3-111) 


3.12 Transfer Functions of Discrete-Data Systems7:® 


It is shown in Chapter 2 that the signals in a discrete-data or sampled-data 
system are in the form of pulse trains. Therefore, the Laplace transform and the 
transfer functions defined for continuous-data systems, in the s-domain, cannot 
be used adequately to describe these systems. 

Figure 3-27(a) illustrates a linear system with transfer function G(s) whose 
input is the output of a finite-pulsewidth sampler. As described in Section 2.8, 
the finite-pulsewidth sampler closes for a short duration of p seconds once 
every T seconds, and a typical set of input and output signals of the sampler is 
shown in Fig. 2-5. Since for a very small pulse duration p, as compared with the 
sampling period 7, the finite-pulsewidth sampler can be approximated by an 
ideal sampler connected in cascade with a constant attenuation p, the system 
of Fig. 3-27(a) may be approximated by the system shown in Fig. 3-27(b). 


r(t) r(t) c(t) 
—____- G(s) 
R(s) 7 (p) Res) C(s) 


(a) 


r(t) + r*(t) =r) G(s) ot 
R(s) r R*(s) = Rp (s) Cs) 
Ideal sampler 


(b) 


Fig. 3-27. (a) Discrete-data system with a finite-pulsewidth sampler. (b) 
Discrete-data system with an ideal sampler that approximates the system 
in (a). 
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Sy 

r(t) = 
RG 

(s) T 

Fig. 3-28, Discrete-data system with an ideal sampler. 


Normally, for convenience, it is assumed that the attenuation factor p is 
included in the transfer function of the process, G(s). Therefore, the block 
diagram of Fig. 3-28 is considered as that of a typical open-loop discrete-data 
or sampled-data system. 

There are several ways of deriving the transfer function representation of 
the system of Fig. 3-28. In the following we shall show two different representa- 
tions of the transfer function of the system. Let us assume that r*(z), the output 
of the ideal sampler S,, is a unit impulse function. This may be obtained by 
sampling a unit step function u,(f) once at t = 0 or if r(t) is a unit impulse func- 
tion.* Unless stated otherwise, the samplers considered in the remaining portion 
of this text are ideal samplers. 

The output of G(s) is the impulse g(¢). If a fictitious ideal sampler S,, which 
is synchronized with S, and has the same sampling period as that of S,, is placed 
at the output of the system as shown in Fig. 3-28, the output of the sampler S, 
may be written as 


c*(t) = g*() = = g(kT)5(t — kT) (3-112) 


where c(kT) = g(kT) is defined as the weighting sequence of the linear process 
G(s). In other words, the sampled version of the impulse response or weighting 
function is the weighting sequence. 

Taking the Laplace transform on both sides of Eq. (3-112) yields 


C*(s) = G*(s) = L[g*@] 


S (3-113) 
= ¥ g(kT)e* 

k=0 
which is defined as the pulse transfer function of the linear process. 

At this point we can summarize our findings about the description of the 
discrete-data system of Fig. 3-28 as follows. When a unit impulse function is 
applied to the linear process, the output is simply the impulse response of the process; 
the impulse response is sampled by a fictitious ideal sampler S,, and the output of 
the sampler is the weighting sequence of the process. The Laplace transform of the 
weighting sequence impulse train gives the pulse transfer function G*(s). 


*Although from a mathematical standpoint the meaning of sampling an impulse function 
is questionable and difficult to define, physically, we may argue that sending a pulse through 
a finite-pulsewidth sampler will retain the same identity of the pulse. 
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Once the weighting sequence of a linear system is defined, the output of 
the system, c(¢), and the sampled output, c*(t), which is due to any arbitrary 
input r(¢), can be obtained by means of the principle of superposition. 

Consider that an arbitrary input r(¢) is applied to the system of Fig. 3-28 
at t = 0. The output of the ideal sampler is the impulse train, 


r*(t) = ¥ r(kT)5(t — kT) (3-114) 
k=0 
By means of superposition, the output of the process, which is due to r*(t), is 
c(t) = r(O)g(t) + HT)g(t — T) +... + rkT) g(t — kT) +... (3-115) 
At t = kT, the last equation becomes 
KT) = rO)g(kT) + r(T)gi(k — IT) +... + rik — 1)T]g(T) + r(kT)g(0) 
(3-116) 
where it is assumed that g(t) is zero for all t < 0, since the process is a physical 
system so that its output does not precede the input. 


Multiplying both sides of Eq. (3-116) by e~*7", and taking the summation 
from k = 0 to k = oo, we have 


Do c(kT)e7 FFs = > r(O)g(kT )e~*F* 4- Dy H(T)gl(k — Tle" +... 


+ Blk — NT Ie(T)e + SY kT) g(Qe-** 


Again, using the fact that g(¢) is zero for negative time, Eq. (3-117) is simplified to 


(3-117) 


> (kT )e-*?* = [r(0) + r(Te-? + QT )e27! +. . J Dy e(kT)e-*7s (3-118) 


or 


Yi c(kT eT = Sr kT)e*t SY o(kT ens (3-119) 
k=0 k=0 k=0 
Therefore, using the definition of the pulse transfer function, the last equation 
is written 

C*(s) = R*(s)G*(s) (3-120) 
which is the input-output transfer relationship of the discrete-data system 
shown in Fig. 3-28. The z-transform relationship is obtained directly from the 
definition of the z-transform. Since z = e7*, Eq. (3-119) is also written 


Y c(kT)z-* = Yo AKT )z-* SY g(kT)2~# (3-121) 
k=0 k=0 k=0 
Therefore, defining the z-transfer function of the process as 
G(z) = ¥ g(kT)z-* (3-122) 
k=0 


which implies that the z-transfer function of a linear system, G(z), is the z- 
transform of the weighting sequence, g(kT), of the system. Equation (3-121) 
is written 

C(z) = R(z)G(z) (3-123) 
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It is important to point out that the output of the discrete-data system is 
continuous with respect to time. However, the pulse transform of the output, 
C*(s), and the z-transform of the output, C(z), specify the values of c(f) only 
at the sampling instants. If c(f) is a well-behaved function between sampling 
instants, c*(t) or C(z) may give an accurate description of the true output c(t). 
However, if c(t) has wide fluctuations between the sampling instants, the z- 
transform method, which gives information only at the sampling instants, will 
yield misleading or inaccurate results. 
The pulse transfer relation of Eq. (3-120) can also be obtained by use of 
the following relation between C*(s) and C(s), which is given in the literature’ : 


C*(s) = - ECs + jnw,) (3-124) 


where q, is the sampling frequency in radians per second and @, = 2z/T. 
From Fig. 3-28, the Laplace transform of the continuous-data output c(t) is 


C(s) = G(s)R*(s) (3-125) 
Substituting Eq. (3-125) into Eq. (3-124) gives 
C*(s) = 7 py G(s -+ jnw,)R*(s + jnoo,) (3-126) 
We can write 
R*(s + jn@,) = > (KT Je~FTs tne 
os (3-127) 
= D r(kT)e*"* 
k=0 
since for integral k and n, 
e@—inkTos = eJ2ank = 1 (3-128) 
Thus Eq. (3-127) becomes 
R*(s + jnw,) = R*(s) (3-129) 
Using this identity, Eq. (3-126) is simplified to 
CH(s) = RS) DL As + jn.) (3-130) 
or 
C*(s) = R*(s)G*(s) (3-131) 
where 
G9) =F LY As + jna) (3-132) 


The transfer function in z of Eq. (3-123) can again be obtained directly from Eq. 
(3-131) by use of z = e”*. 

In conclusion, we note that when the input to a linear system is sampled 
but the output is unsampled, the Laplace transform of the continuous output 
is given by 

C(s) = G(s)R*(s) (3-133) 


If the continuous-data output is sampled by a sampler that is synchronized with 
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and has the same sampling period as the input, the Laplace transform of the 
discrete-data output is given by 


C*(s) = G*(s)R*(s) (3-134) 


The result in Eq. (3-133) is natural, since it is in line with the well-established 
transfer relation for linear time-invariant systems. The expression in Eq. (3-134) 
is obtained by use of Eqs. (3-124) and (3-132). However, it can be interpreted as 
being obtained directly from Eq. (3-133) by taking the pulse transform on both 
sides of the equation. In other words, in view of Eq. (3-129), we can write, from 
Eq. (3-133), 

C*(s) = [G(s)R*(s)]}* (3-135) 

= G*(s)[R*(s)]* 

where Eq. (3-134) implies that 


[R*(s)]* = R*(s) (3-136) 


Transfer Functions of Discrete-Data Systems with Cascaded Elements 


The transfer function representation of discrete-data systems with cascaded 
elements is slightly more involved than that for continuous-data systems, 
because of the variation of having or not having any samplers in between the 
elements. Figure 3-29 illustrates two different situations of a discrete-data 
system which contains two cascaded elements. In the system of Fig. 3-29(a), the 
two elements are separated by a sampler S, which is synchronized to and has 


* 
ey) 
[ ' ce) 
i 
| 


- e*(t) 
| T “™(s) 
Es Pao | | 
r(t) r*(t) d(t) e(t) 
Oy G G 
ae pol we) ) 


(b) 


Fig. 3-29. (a) Discrete-data system with cascaded elements and sampler 
separates the two elements. (b) Discrete-data system with cascaded ele- 
ments and no sampler in between. 
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the same period as the sampler S,. The two elements with transfer functions 
G,(s) and G,(s) of the system in Fig. 3-29(b) are connected directly together. In 
discrete-data systems, it is important to distinguish these two cases when deriving 
the pulse transfer functions. 

Let us consider first the system of Fig. 3-29(a). The output of G,(s) is written 


D(s) = G,(s)R*(s) (3-137) 
and the system output is 
C(s) = G,(s)D*(s) (3-138) 


Taking the pulse transform on both sides of Eq. (3-137) and substituting the 
result into Eq. (3-138) yields 


C(s) = G,(s)GF(s)R*(s) (3-139) 
Then, taking the pulse transform on both sides of the last equation gives 
C*(s) = Gi(s)G(s)R*(s) (3-140) 


where we have made use of the relation in Eq. (3-136). The corresponding 
z-transform expression of the last equation is 


C(z) = G,(z)G,(z)R(z) (3-141) 


We conclude that the z-transform of two linear elements separated by a sampler 
is equal to the product of the z-transforms of the two individual transfer func- 


ene Laplace transform of the output of the system in Fig. 3-29(b) is 
C(s) = G,(s)G,(s)R*(s) (3-142) 
The pulse transform of the last equation is 
C*(s) = [G,(s)G,(s)]*R*(s) (3-143) 
where 
[Gi(s)Gx65)I* = Gls + jne,)Gx(s + jne,) (3-144) 


Notice that since G,(s) and G,(s) are not separated by a sampler, they have to 
be treated as one element when taking the pulse transform. For simplicity, we 
define the following notation: 


[G,(s)G2(s)]* = G,G7(s) 


~ 6,64) (3-145) 


Then Eq. (3-143) becomes 
C*(s) = G,GF(s)R*(s) (3-146) 
Taking the z-transform on both sides of Eq. (3-146) gives 
C(z) = G,G,(z)R(z) (3-147) 


where G,G,(z) is defined as the z-transform of the product of G,(s) and G,(s), 
and it should be treated as a single function. 
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It is important to note that, in general, 


G,G3(s) # Gt(s)Gi(s) (3-148) 
and 
G,G,(z) # G,(z)G,(z) (3-149) 


Therefore, we conclude that the z-transform of two cascaded elements with no 
sampler in between is equal to the z-transform of the product of the transfer 
functions of the two elements. 


Transfer Functions of Closed-Loop Discrete-Data Systems 


In this section the transfer functions of simple closed-loop discrete-data 
systems are derived by algebraic means. Consider the closed-loop system shown 
in Fig. 3-30. The output transform is 


C(s) = G(s)E*(s) (3-150) 


~ c*(t) 
et 
[ C*(s) 
{ c(t) 


R(s) 


Fig. 3-30. Closed-loop discrete-data system. 


The Laplace transform of the continuous error function is 


E(s) = R(s) — H(s)C(s) (3-151) 
Substituting Eq. (3-150) into Eq. (3-151) yields 
E(s) = R(s) ~ G(s)H(s)E*(s) (3-152) 


Taking the pulse transform on both sides of the last equation and solving for 
E*(s) gives 


¥(°) = R*(s) 
E*(s) = T+ GH%) (3-153) 


The output transform C(s) is obtained by substituting E*(s) from Eq. (3-153) 
into Eq. (3-150); we have 


C(s) = ora (3-154) 


Now taking the pulse transform on both sides of Eq. (3-154) gives 


* ifs G*(s) * : 
C*(s) = T+ GH%)* (s) (3-155) 
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In this case it is possible to define the pulse transfer function between the input 
and the output of the closed-loop system as 


C¥(s)_ __—G*(s) 


R¥(s) — T+ GH*S) Cu) 
The z-transfer function of the system is 
CG) a Oe) (3-157) 


RQ) 1+ GH() 

We shall show in the following that although it is possible to define a 
transfer function for the closed-loop system of Fig. 3-30, in general, this may 
not be possible for all discrete-data systems. Let us consider the system shown 
in Fig. 3-31. The output transforms, C(s) and C(z), are derived as follows: 


C(s) = G(s)E(s) (3-158) 
E(s) = R(s) — H(s)C*(s) (3-159) 
“> c*(t) 
sé C*(s) 


r-—7 ~~ = 
| 
‘ 
t 
i 


Fig. 3-31. Closed-loop discrete-data system. 


Substituting Eq. (3-159) into Eq. (3-158) yields 
C(s) = G(s)R(s) — G(s)H(s)C*(s) (3-160) 
Taking the pulse transform on both sides of the last equation and solving for 
C*(s), we have 
GR*(s) 
1 + GH*(s) 
Note that the input and the transfer function G(s) are now combined as one 
function, GR*(s), and the two cannot be separated. In this case we cannot define 
a transfer function in the form of C*(s)/R*(s). 
The z-transform of the output is determined directly from Eq. (3-161) to be 


GR(z) 


OS) = (3-161) 


where it is important to note that 
GR(z) = a[G(s)R(S)] (3-163) 


and 
GH(z) = g[G(s)H(s)] (3-164) 
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To determine the transform of the continuous output, C(s), we substitute 
C*(s) from Eq. (3-161) into Eq. (3-160). We have 
= _ —(S)H(5)_Gpe - 
C(s) = G(s)R(s) +6 H*yeR (s) (3-165) 
Although we have been able to arrive at the input-output transfer function 
and transfer relation of the systems of Figs. 3-30 and 3-31 by algebraic means 
without difficulty, for more complex system configurations, the algebraic method 


may become tedious. The signal-flow-graph method is extended to the analysis 
of discrete-data systems; the reader may refer to the literature.’-® 
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PROBLEMS 


3.1. The following differential equations represent linear time-invariant systems, 


where r(t) denotes the input and c(t) denotes the output. Find the transfer 
function of each of the systems. 


d 3? di 
(a) FAO 4 3D gD 4 (ey = 24O + He 
(b) HO + 10 + ae(t) = ree — 2) 


3.2. The block diagram of a multivariable feedback control system is shown in Fig. 
P3-2. The transfer function matrices of the system are 
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Figure P3-2. 
3.3. A multivariable system with two inputs and two outputs is shown in Fig. P3-3. 
Determine the following transfer function relationships: 


Cis) C2(s) Cis) C2(s) 
Ri(s) |xe=0 Ry(s) |= 0 R2(s) |r=0 R2(5) jr.=0 


Write the transfer function relation of the system in the form 
C(s) = G(s)R(s) 


Figure P3-3. 


3.4. Draw a signal flow graph for the following set of algebraic equations: 
3x, + x2 + 5x3 =0 
x, + 2X2 = 4x3 = 2 


—XxX,—x3; =0 
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3.5. Draw an equivalent signal flow graph for the block diagram in Fig. P3-5. Find 
the transfer function C(s)/R(s). 


Figure P3-5. 


3.6. Find the gains, y¢/v1, ¥3/v1, and ys/y2 for the signal flow graph shown in Fig. 
P3-6. 


Figure P3-6. 


3.7. Find the gains ys/y, and y2/y1 for the signal flow graph shown in Fig. P3-7. 


Figure P3-7. 
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3.8. In the circuit of Fig. P3-8, e,(t), et), and i,(f) are ideal sources. Find the value 
of aso that the voltage eo(t) is not affected by the source e,(f). 


Figure P3-8. 


3.9. Are the two systems shown in Fig. P3-9(a) and (b) equivalent ? Explain. 


(a) 


yy v2 


d e if 


(b) 
Figure P3-9. 


3.10. Given the signal flow graph of Fig. P3-10(a) and the transfer functions G;, G2, 
G3, G4, and Gs, find the transfer functions G4, Gg, and Gc so that the three 
systems shown in Fig. P3-10 are all equivalent. 


(a) 


Figure P3-10. 
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(c) 


Figure P3-10. (Cont.) 


3.11. Construct an equivalent signal flow graph for the block diagram of Fig. P3-11. 


(a) Evaluate the transfer function C/R when N = 0. (b) Determine the relation 
among the transfer functions G,, G2, G3, Gs, H,, and H, so that the output C 
is not affected by the disturbance signal N. 


Figure P3-11. 


3.12. A multivariable system is described by the following matrix transfer function 
relations: 


Cis) = G(s)E(s) 
&(s) = R(s) — H(s)C(s) 


= ed a a 
er Be eG) 


where 


5 
wo Pl ol 9 
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(a) Derive the closed-loop transfer function relationship 


C(s) = M(s)R(s) 
by using 


M(s) = [I + G@)H()F GG) 
(b) Draw a signal flow graph for the system and find M(s) from the signal flow 
graph using Mason’s gain formula. 
3.13. Find the transfer function relations C(s)/R(s) and C(s)/E(s) for the system 
shown in Fig. P3-13. 


Figure P3-13. 


3.14. Find the transfer function C(z)/R(z) of the discrete-data system shown in Fig. 
P3-14. The sampling period is 1 sec. 


r(t) HO 


T 


Figure P3-14. 


3.15. Find the z-transfer functions C(z)/R(z) of the discrete-data systems shown in 
Fig. P3-15. 


r(t) x 
T 


(a) 


LO Gad) 1 
Mi oF 
() 


Figure P3-15. 


4 


State-Variable Characterization 


4.1 


of Dynamic Systems 


Introduction to the State Concept 


In Chapter 3 the classical methods of describing a linear system by transfer 
function, impulse response, block diagram, and signal flow graph have been 
presented. An important feature of this type of representation is that the system 
dynamics are described by the input-output relations. For instance, the trans- 
fer function describes the input-output relation in the Laplace transform do- 
main. However, the transform method suffers from the disadvantage that all 
the initial conditions of the system are neglected. Therefore, when one is in- 
terested in a time-domain solution, which depends to a great deal on the past 
history of the system, the transfer function does not carry all the necessary 
information. Transfer function is valuable for frequency-domain analysis and 
design, as well as for stability studies. The greatest advantage of transfer 
function is in its compactness and the ease that we can obtain qualitative in- 
formation on the system from the poles and zeros of the transfer function. 

An alternative to the transfer function method of describing a linear system 
is the sfate-variable method. The state-variable representation is not limited 
to linear systems and time-invariant systems. It can be applied to nonlinear as 
well as time-varying systems. 

The state-variable method is often referred to as a modern approach. 
However, in reality, the state equations are simply first-order differential equa- 
tions, which have been used for the characterization of dynamic systems for 
many years by physicists and mathematicians. 

To begin with the state-variable approach, we should first begin by de- 
fining the state of a system. As the word implies, the state of a system refers to 
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the past, present, and future conditions of the system. It is interesting to note 
that an easily understood example is the “State of the Union” speech given by 
the President of the United States every year. In this case, the entire system 
encompasses all elements of the government, society, economy, and so on. In 
general, the state can be described by a set of numbers, a curve, an equation, 
or something that is more abstract in nature. From a mathematical sense it is 
convenient to define a set of state variables and state equations to portray sys- 
tems. There are some basic ground rules regarding the definition of a state 
variable and what constitutes a state equation. Consider that the set of variables, 
x,(t), X,(t),..., x,(¢) is chosen to describe the dynamic characteristics of a 
system. Let us define these variables as the state variables of the system. Then 
these state variables must satisfy the following conditions: 


1. At any time f= fy, the state variables, x,(f)), Xo(to)s- + +> Xqlto) 
define the initial states of the system at the selected initial time. 

2. Once the inputs of the system for ¢ > fg and the initial states defined 
above are specified, the state variables should completely define the 
future behavior of the system. 


Therefore, we may define the state variables as follows: 


Definition of state variables. The state variables of a system are defined as 
a minimal set of variables, x,(t), x2(t),...,%,(t) such thai knowledge of these 
variables at any time to, plus information on the input excitation subsequently 
applied, are sufficient to determine the state of the system at any time t > tp. 

One should not confuse the state variables with the outputs of a system. 
An output of a system is a variable that can be measured, but a state variable 
does not always, and often does not, satisfy this requirement. However, an 
output variable is usually defined as a function of the state variables. 


R EXAMPLE 4-1 _— As a simple illustrative example of state vari- 

ik ables, let us consider the RL network shown 
in Fig. 4-1. The history of the network is 

e(t) > L completely specified by the initial current of the inductance, 
i(0+), at = 0. At t = 0, aconstant input voltage of ampli- 


Fig. 4-1. RL network. 


tude E, is applied to the network. The loop equation of the 
network for t > 0 is 


e(t) = Ri(t) + LE (4-1) 
Taking the Laplace transform on both sides of the last equation, we get 
E(s) = 2 =(R + LaMls) — Li@+) (4.2) 


Solving for I(s) from the last equation yields 


oe 
s(R + Ls) 


Li(0+) 


I(s) = R+Ls 


+ 


(4-3) 


The current i(¢) for ¢ => 0 is obtained by taking the inverse Laplace transform of both 
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sides of Eq. (4-3). We have 
i) = — eB) + OH) (4-4) 


Once the current i(¢) is determined for t > 0, the behavior of the entire network is 
defined for the same time interval. Therefore, it is apparent that the current i(t) in this 
case satisfies the basic requirements as a state variable. This is not surprising since an 
inductor is an electric element that stores kinetic energy, and it is the energy storage 
capability that holds the information on the history of the system. Similarly, it is easy 
to see that the voltage across a capacitor also qualifies as a state variable. 


4.2 State Equations and the Dynamic Equations 


e(t) 


The first-order differential equation of Eq. (4-1), which gives the relationship 
between the state variable i(t) and the input e(t), can be rearranged to give 

dit) —R. 1 : 
| ie TiO + L e(t) (4-5) 
This first-order differential equation is referred to as a state equation. 

For a system with p inputs and g outputs, the system may be linear or 
nonlinear, time varying or time invariant, the state equations of the system are 
written as 

dx{t 
PAD — Fhe, AD, HO OrDr 7] (4-6) 
i=1,2,...,n 


where ~x,(¢), x2(¢),...,.,(¢) are the state variables; r,(¢),r,(2),...,7,(t) are 
the input variables; and f, denotes the ith functional relationship. 

The outputs of the system c,(t),k = 1,2,...,q, are related to the state 
variables and the inputs through the output equation, 


c,{t) = BxlX1(2), x(t), Cee 2 x,(t), r,(t), r(t), Sree | rj(t)] (4-7) 
= 1,2,...,¢ 


where g, denotes the kth functional relationship. The state equations and the 
output equations together form the set of equations which are often called the 
dynamic equations of the system. 

Notice that for the state equations, the left side of the equation should 
contain only the first derivatives of the state variables, while the right side should 
have only the state variables and the inputs. 


EXamPLe 4-2 Consider the RLC network shown in Fig. 4-2. Using the conven- 
tional network approach, the loop equation of the network is 


L written 


| . = RID + LED +E fia 48) 
i(t) Cae, (t) 
| We notice that this equation is not in the form of a state 


equation, since the last term is a time integral. One method 
of writing the state equations of the network, starting with 


Fig. 4-2. RLC network. Eq. (4-8), is to let the state variables be defined as 
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x(t) =i (4-9) 
x(t) = { i(t) dt (4-10) 
Substituting the last two equations into Eq. (4-8), we have 
dx es) 


et) = RuO +L Ext) (4-11) 


Rearranging the terms in Eq. (4-11) and se the time derivative on both sides 
of Eq. (4-10), we have the two state equations of the network, 


PH 2x - ie x(t) ++ felt) (4-12) 


oO) 


= x(t) (4-13) 
which are linear first-order differential equations. 


We have demonstrated how the state equations of the RLC network may 
be written from the loop equations by defining the state variables in a specific 
way. The objective, of course, is to replace Eq. (4-8) by two first-order differential 
equations. An alternative approach is to start with the network and define the 
state variables according to the elements of the network. As stated in Section 
4.1, we may assign the current through an inductor and the voltage across a 
capacitor as state variables. Therefore, with reference to Fig. 4-2, the state 
variables are defined as 

x,(t) = i@) (4-14) 

X(t) = e-(t) (4-15) 
Then, knowing that the state equations would have to contain the first deriva- 
tives of x,(t) and x,(r) on the left side of the equations, we can write the equa- 
tions directly by inspection from Fig. 4-2: 


Voltage across L: pO .. Ri(t) — et) + e(t) (4-16) 
Current inc: CHAO — iq) (4-17) 


Using Eqs. (4-14) and (4-15), and dividing both sides of the last two equations 
by L and C, respectively, we have 


MO Ry Q-FxO+ pO G18) 
PX _ Fx) (4-19) 


which are the state equations of the RLC network. We notice that using the 
two independent methods, the only difference in the results is in the definition 
of the second state variable x,(¢). Equation (4-19) differs from Eq. (4-13) by 
the factor of the capacitance C. 

From these two simple examples we see that for linear time-invariant 
systems, the state equations can generally be written as 
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dx _ => a,x (t) os » b,,r,(t) i=1,2,...,n (4-20) 


where a,, and - are constant coefficients. The output equations are written 


n Pp 
e,{t) > py dy jX,(t) + py Cem! m(t) k ad 1, 2, re’ | (4-21) 


where d,; and e,,, are constant coefficients, 
For a linear system with time-varying parameters, the coefficients of Eqs. 
(4-20) and (4-21) become time dependent. 


4.3 Matrix Representation of State Equations 


The dynamic equations are more conveniently expressed in matrix form. Let 
us define the following column matrices: 


x(t) 
X(t) 
xt) =| °¢ (n xX 1) (4-22) 
| x,(0) 
where x(t) is defined as the state vector; 
r,(t) 
r(t) 
r=] ° (p x 1) (4-23) 
0) 
where r(t) is defined as the input vector; and 
c,(t) 
c2(¢) 
c(t) =| (gq X 1) (4-24) 
c(t) 


where ¢(t) is defined as the output vector. Then the state equations of Eq. (4-6) 
can be written 


HO — tix(9, r(0) (4-25) 
dt 
where f denotes an » x | column matrix that contains the functions Tish aston 
J, as elements, and the output equations of Eq. (4-7) become 
e(t) = g[x(2), r(2)] (4-26) 


where g denotes ag xX 1 column matrix that contains the functions Z1,8a,-.- 
g, as elements. 


? 
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For a linear time-invariant system, the dynamic equations are written 


State equation: axe) = Ax(t) + Br(t) (4-27) 
Output equation: ¢(#) = Dx(¢) + Er(7) (4-28) 
where A is ann X n coefficient matrix given by 
Ais Ayn wee Ay 
Qrx, G22 «+s Aan 
A=|- : : (4-29) 
ant ay ann 
Bis ann X p matrix given by 
bi, b 12 b 1p 
b2, bz, eee bap 
B=|- . . (4-30) 
Ont Baa Dap 
D is aq X n matrix given by 
d, 1 d, 2 di, 
dz, drrz ... d2, 
D=| ° : . (4.31) 
dy, dy, Aan 
and Eis ag X p matrix, 
Oy, 252 Cin 
C21 C22 see Crp 
E=|° z . . (4-32) 
Cut qn ees Cap 


EXAMPLE 4-3. The state equations of Eqs. (4-18) and (4-19) are expressed in matrix- 
vector form as follows: 


dx(t)) ~_R _1 1 


> —F+|| x1) > 
at L L : L 
dx{t)| | 1 FL fete) (23) 
2! — 
a C 0 x2(t) 0 
Thus the coefficient matrices A and B are identified to be 
oR de 
L L 
A= (4-34) 
Lo 
Cc 
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1 
B= H (4-35) 
0 


The state transition matrix is defined as a matrix that satisfies the linear homo- 
geneous state equation 


4.4 State Transition Matrix 


ete) = Ax(t) (4-36) 


Let $(t) be an m x n matrix that represents the state transition matrix; then it 
must satisfy the equation 


a8) — age) (4-37) 
j t 
Furthermore, let x(0+) denote the initial state at ¢ = 0; then (1) is also defined 
by the matrix equation 

x(t) = o()x(0+) (4-38) 
which is the solution of the homogeneous state equation for t > 0. 


One way of determining $(¢) is by taking the Laplace transform on both 
sides of Eq. (4-36); we have 


sX(s) — x(0+) = AX(s) (4-39) 
Solving for X(s) from the last equation, we get 
X(s) = (sI — A)~!x(0+) (4-40) 


where it is assumed that the matrix (sI — A) is nonsingular. Taking the inverse 
Laplace transform on both sides of the last equation yields 


x(t) = £7 [(st — A) '}x(0+) t>0 (4-41) 


Comparing Eq. (4-41) with Eq. (4-38), the state transition matrix is identified 
to be 

ot) = £ (sl — A)~*) (4-42) 
An alternative way of solving the homogeneous state equation is to assume a 


solution, as in the classical method of solving differential equations. We let 
the solution to Eq. (4-36) be 


x(t) = e“'x(0+) (4-43) 
for ¢ > 0, where e4* represents a power series of the matrix Art and 


MT b Art PAM + PA. (4-44)* 


It is easy to show that Eq. (4-43) is a solution of the homogeneous state 
equation, since, from Eq. (4-44), 


A 
de" = AeM (4-45) 


*It can be proved that this power series is uniformly convergent. 
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Therefore, in addition to Eq. (4-42), we have obtained another expression for 
the state transition matrix in 


o(t) = eM = 14+ At+ 4a + nae toe, (4-46) 


Equation (4-46) can also be obtained directly from Eq. (4-42). This is left as an 
exercise for the reader (Problem 4-3). 


EXAMPLE 4-4 Consider the RZ network of Fig. 4-1 with the input short circuited; 
that is, e(t) = 0. The homogeneous state equation is written 


di(t)_ _R 


ame ve i(t) (4-47) 
The solution of the last equation for ¢ > Ois obtained from Eq. (4-4) by setting E, = 0. 
Thus 
i(t) = e-F/43(0+-) (4-48) 
The state transition matrix in this case is a scalar and is given by 
GQ) =e" 1>0 (4-49) 


which is a simple exponential decay function. 


Significance of the State Transition Matrix 


Since the state transition matrix satisfies the homogeneous state equation, 
it represents the free response of the system. In other words, it governs the 
response that is excited by the initial conditions only. In view of Eqs. (4-42) 
and (4-46), the state transition matrix is dependent only upon the matrix A. 
As the name implies, the state transition matrix $(t) completely defines the 
transition of the states from the initial time ¢ = 0 to any time ¢. 


Properties of the State Transition Matrix 


The state transition matrix (t) possesses the following properties: 


1, o(0) = 1 the identity matrix (4-50) 
Proof: Equation (4-50) follows directly from Eq. (4-46) by setting 

t= 0. 
2. oO) = o(—2) (4-51) 
Proof: Postmultiplying both sides of Eq. (4-46) by e74', we get 
(te “* = eAte“At = J (4-52) 

Then premultiplying both sides of Eq. (4-52) by 6-'(1), we get 
e At = @'(t) (4-53) 
Thus 

o(—N=o'O=e™ (4-54) 


An interesting result from this property of (t) is that Eq. (4-43) can be re- 
arranged to read 


x(0+-) = 6(—2)x(1) (4-55) 


' 
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which means that the state transition process can be considered as bilateral in 
time. That is, the transition in time can take place in either direction. 


3. P(t, — t1)O(t, — to) = P(t. — to) for any fo, t,t, (4-56) 
Proof: 
Ot, — 13) G(t, — to) = edteMeAtar—n) 
= eAlts-to) (4-57) 
= Ot, — to) 
This property of the state transition matrix is important since it implies 


that a state transition process can be divided into a number of sequential 
transitions. Figure 4-3 illustrates that the transition from 1 — t, to f= ft, is 


O(t, — fg) >| 
x) x(t) 


| 
4 
| 
{ 


X (ty) 


Oty =) 4 $(ty ty) 


| 
a a a a D 
0 ty ty 


Fig. 4-3. Property of the state transition matrix. 


equal to the transition from ¢, to t,, and then from f, to f,. In general, of course, 
the transition process can be broken up into any number of parts. 
Another way of proving Eq. (4-56) is to write 


x(t.) = (1, — t,)x(t,) (4-58) 
X(t1) = O(t, — to)x(ty) (4-59) 
X(t2) = O(t, — to)x(ty) (4-60) 


The proper result is obtained by substituting Eq. (4-59) into Eq. (4-58) and 
comparing the result with Eq. (4-60). 


as [6@ = (kt) for k = integer (4-61) 
Proof: 
[d()I* = eves. e4 (Kk terms) 
ae (4-62) 
= (kt) 


4.5 State Transition Equation 


The state transition equation is defined as the solution of the linear nonhomo- 
geneous state equation. For example, Eq. (4-5) is a state equation of the RL 
network of Fig. 4-1. Then Eq. (4-4) is the state transition equation when the 
input voltage is constant of amplitude E, for t > 0, 
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In general, the linear time-invariant state equation 
ao = Ax(t) + Br(t) (4-63) 


can be solved by using either the classical method of solving differential equa- 
tions or the Laplace transform method. The Laplace transform method is 
presented in the following. 
Taking the Laplace transform on both sides of Eq. (4-63), we have 
sX(s) — x(0+) = AX(s) + BR(s) (4-64) 
where x(0+-) denotes the initial state vector evaluated at ¢ == 0+. Solving for 
X(s) in Eq. (4-64) yields 
X(s) = (sI — A)~'x(0+) + (sI — A)"'BR(s) (4-65) 
The state transition equation of Eq. (4-63) is obtained by taking the inverse 
Laplace transform on both sides of Eq. (4-65), 
x(t) = £-'[(sI — A)~']x(0+) + L&-'[(sI — A)" 'BR(s)] (4-66) 


Using the definition of the state transition matrix of Eq. (4-42), and the con- 
volution integral, Eq. (3-26), Eq. (4-66) is written 


x(t) = $(x(0+) + f : o(t — t)Br(z) drt 20 (4-67) 


The state transition equation in Eq. (4-67) is useful only when the initial 
time is defined to be at t = 0. In the study of control systems, especially dis- 
crete-data control systems, it is often desirable to break up a state transition 
process into a sequence of transitions, so that a more flexible initial time must 
be chosen. Let the initial time be represented by ¢, and the corresponding initial 
state by x(f,), and assume that an input r(¢) is applied for ¢ >> fy. 

We start with Eq. (4-67) by setting ¢ = f), and solving for x(0+-), we get 


x(O+) = G(—te)x(t) = 6(—te) [6 — Bra) dr (4-68) 
where the property on (1) of Eq. (4-51) has been used. 
Substituting Eq. (4-68) into Eq. (4-67) yields 
X() = $()6(—to)X(F0) ~ 6 6(—to) [Fo — 1)Br(t) de 
+f : (t — 2)Br(z) dr 
Now using the property of Eq. (4-56), and combining the last two integrals, 
Eq. (4-69) becomes 
X(0) = O(6 ~ to)Ct0) + f(t ~ 2) Br(e) dz (4-70) 
It is apparent that Eq. (4-70) reverts to Eq. (4-67) when 7, = 0. 
Once the state transition equation is determined, the output vector can be 
expressed as a function of the initial state and the input vector simply by sub- 
stituting x(t) from Eq. (4-70) into Eq. (4-28). Thus the output vector is written 


c(t) = Dot — to) X(t) + f Do(t — 1)Br(t) dz -'- Er(t) (4-71) 


(4-69) 
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The following example illustrates the application of the state transition 
equation. 


EXAMPLE 4-5 — Consider the state equation 


au 0 ilfx@] fo 
= +] Ir (4-72) 
ol) oi eee a 


The problem is to determine the state vector x(t) for t > 0 when the input r(t) = 1 for 
t = 0; that is, r(¢) = u(t). The coefficient matrices A and B are identified to be 


A= | 2 x B= Fi (4-73) 
~2 -—3 1| 
aa I-08 6 
0 s —2 -3 2 s+3 
The matrix inverse of (sI — A) is 


ye 1 s4+3 1 
aay EES = | oe 


The state transition matrix of A is found by taking the inverse Laplace transform of 
the last equation. Thus 


Therefore, 


(1) = LE — Ay] = [ (4-75) 


—2em! + Qenm2t et + De-2t 


The state transition equation for ¢ > 0 is obtained by substituting Eq. (4-75), B, and 
r(t) into Eq. (4-67). We have 


Det ss e72t ef — e-2t 
n= x(O 
iO eo. pet wert oa os) 


t 2e- tat) e@7 2-1) en (t-t) e7 2(t-2) 0 
iv [ Bae + 2e~ 2-2) —e- (tt) + ean dt (4-76) 


2e-t — eu ent — ett | 


or 
2e-- — e72t e7t — ed 
me) -| Qe + Qen2t ment 4 | x0) 
1 fo 1 o- 21 er) 
5 e xe" 
ee eee 


As an alternative, the second term of the state transition equation can be obtained by 
taking the inverse Laplace transform of (sl — A)-'BR(s). Therefore, 


1 170 
SME AYER = Bee TF TOL 


1 
2 1 ae 
a £ ms (4-78) 


1 _ p-t Jer 
-|? . + fe | t>0 


ef — en 2t 
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Example 4-6 In this example we shall illustrate the utilization of the state transition 
method to a system with input discontinuity. Let us consider that the 
input voltage to the RL network of Fig. 4-1 is as shown in Fig. 4-4. 


2E 
e(t) 


0 4 


Fig. 4-4. Input voltage waveform for the network in Fig. 4-1. 


The state equation of the network is 


M9) Ri Lew (4-79) 
Thus 
R 4 
A = a B= 77 (4-80) 
The state transition matrix is 
P(t) = en RE (4-81) 
One approach to the problem of solving for i(r) for t > 0 is to express the input 
voltage as 
e(t) = Eu,(t) + Eu,(t — t,) (4-82) 
where u(t) is the unit step function. The Laplace transform of e(r) is 
E(s) = £0 tes) (4-83) 
Then | 
(sI — A) BR(s) = —1 FL Egg ery 
sTRILL's | 
2 (4-84) 


~ Ret + GR Fe | 
Substituting Eq. (4-84) into Eq. (4-66), the current for t > 0 is obtained: 
i(t) =e BHO Hult) +B — eur) 
E (4-85) 
pL ee ee 28) 
Using the state transition approach we can divide the transition period into two 


parts: f =0 tof=14,, and t =f, to ¢ = oo. First for the time interval, O< +< 4, 
the input is 


e(t) = Eu,(t) O<t<h, (4-86) 
Then 
. Sh a 
Gh ABS) So EL 
i (4-87) 


~ Rs[l + (L/R)s} 


Sec. 4.6 Relationship Between State Equations / 107 


Thus the state transition equation for the time interval 0 < t< 1, is 
i(t) = [e-™tiO+) + ZU — e-*2)) ult) (4-88) 
Substituting ¢ == 7, into this equation, we get 
ity) = e-®tH(04) +E = emt) (4-89) 


The value of i(t) at ¢ = ft, is now used as the initial state for the next transition 
period of tr; < t < co, The magnitude of the input for this interval is 2E. Therefore, 
the state transition equation for the second transition period is 


2 i(t) = e-RU-H/L i(t,) +78 [I —e-Re-vz] tty (4-90) 


where i(f,) is given by Eq. (4-89). 

This example illustrates two possible ways of solving a state transition problem. 
In the first approach, the transition is treated as one continuous process, whereas in 
the second, the transition period is divided into parts over which the input can be more 
easily represented. Although the first approach requires only one operation, the second 
method yields relatively simple results to the state transition equation, and it often 
presents computational advantages. Notice that in the second method the state at 
t = ¢t, is used as the initial state for the next transition period, which begins at f,. 


4.6 Relationship Between State Equations and High-Order 
Differential Equations 


In preceding sections we defined the state equations and their solutions for 
linear time-invariant systems. In general, although it is always possible to 
write the state equations from the schematic diagram of a system, in practice 
the system may have been described by a high-order differential equation or 
transfer function. Therefore, it is necessary to investigate how state equations 
can be written directly from the differential equation or the transfer function. 
The relationship between a high-order differential equation and the state equa- 
tions is discussed in this section. 

Let us consider that a single-variable, linear time-invariant system is de- 
scribed by the following mth-order differential equation: 


d"c(t) 
dt” 


+a ae oe of) +a ee FO. oe Faye acts) + a,ct)=r(t) (4-91) 
where c(t) is the output variable and r(t) is the input. 

The problem is to represent Eq. (4-91) by n state equations and an output 
equation. This simply involves the defining of the n state variables in terms of 
the output c(t) and its derivatives. We have shown earlier that the state vari- 
ables of a given system are not unique. Therefore, in general, we seek the most 
convenient way of assigning the state variables as long as the definition of state 
variables stated in Section 4.1 is met. 
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For the present case it is convenient to define the state variables as 


xi) = ett) 
x,(t) = ats) 
(4-92) 
1) = 12 
Then the state equations are 
dO — x5(0) 
PH) = x,(0 
(4-93) 
HO — x0) 
PO — — ay (t) = aya) — 2. — 2% — 4.x) +O 


where the last state equation is obtained by equating the highest-ordered deriva- 
tive term to the rest of Eq. (4-91). The output equation is simply 


c(t) = x,(¢) (4-94) 
In vector-matrix form, Eq. (4-93) is written 
a) = Ax(t) + Br(t) (4-95) 


where x(t) is the m X 1 state vector and r(r) is the scalar input. The coefficient 
matrices are 


0 1 0 0 0 oo 
0 0 1 0 0 0 
0 0 1 0 o | 
A= (nxn) (4-96) 
0 0 0 0 0 1 | 
Hee: a, Tan) Qn-2 a, 3 Qn-4 —a, | 
0 
0 
B=|- (nx 1) (4-97) 
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The output equation in vector-matrix form is 
c(t) = Dx(r) (4-98) 
where 
D=[f1 00...9 (1 xn) (4-99) 
The state equation of Eq. (4-95) with the matrices A and B defined as in 


Eqs. (4-96) and (4-97) is called the phase-variable canonical form in the next 
section. 


EXAMPLE 4-7 —_ Consider the differential equation 


d3c(t) d2c(t) | de(t) = 

tr dt2 +a + 2clt) = ro) (4-100) 
Rearranging the last equation so that the highest-order derivative term is equated to 
the rest of the terms, we have 


oo mae oe set dott) — 2c(t) + r(t) (4-101) 


The state variables are defined as 


x1(t) = c(t) 
— aelt) 
x2(t) = a (4-102) 
d2c(t 
X3(t ) rca at ) 
Then the state equations are represented by the vector-matrix equation of Eq. (4-95) 
with 
0 1 0 
A=| 0 0 1 (4-103) 
—2 -1 —5 
and : 
0 
B=/0 (4-104) 
1 
The output equation is 
c(t) = x,(r) (4-105) 


4.7 Transformation to Phase-Variable Canonical Form 


In general, when the coefficient matrices A and B are given by Eqs. (4-96) and 
(4-97), respectively, the state equation of Eq. (4-95) is called the Phase-variable 
canonical form. It is shown in the following that any linear time-invariant sys- 
tem with single input and satisfying a certain condition of controllability (see 
section 4.15) can always be represented in the phase-variable canonical form. 


Theorem 4-1. Let the state equation of a linear time-invariant system be 
given by 


at) = Ax(t) + Br(t) (4-106) 
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where x(t) is ann X 1 state vector, A ann X n coefficient matrix, B ann X I 


coefficient matrix, and r(t) a scalar input. If the matrix 
S=[B AB A?B ... A”'B] 
is nonsingular, then there exists a nonsingular transformation 
y(t) = Px(2) 

or 

x(t) = P-'y() 
which transforms Eq. (4-106) to the phase-variable canonical form 

y(t) = A.y(t) + B,r(4) 


where 
0 1 0 0 en 07 
0 0 1 0 0 
0 0 0 1 0 
A, = 
0 0 ) 0 1 
ja, an —ay-2 aQn-3 —a, 
and 
0 
0 
B, =| ° 
1 
The transforming matrix P is given by 
P, 
PA 
P= : 
P,A""? 
where 
P,=(0 0... 1)[B AB A’B ... A*-'B)! 
Proof: Let 
X,(t) 
x(t) 


x(t) = 


x,(t) 


(4-107) 


(4-108) 


(4-109) 


(4-110) 


(4-111) 


(4-112) 


(4-113) 


(4-114) 


(4-115) 
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yi(t) 
y2(t) 
y@)=| ° (4-116) 
n(t) 
and 
Pir Piz . Pin P, 
Pox Pra . Pan P, 
Pee | os fA ie recta tte Il (4-117) 
Pai Pn2 Pan P, 
where 
P, = ([p,; Piz ++ Dinl i=1,2,...,n (4-118) 


Then, from Eq. (4-108), 
Vi = P41X,(t) + Py2X(t) +... 4 PinX,A(t) 
= P,x() 


Taking the time derivative on both sides of the last equation and in view of 
Egs. (4-110) and (4-111), 


Wi = y(t) = P,X@) = P,Ax(t) + P,Br(2) (4-120) 


Since Eq. (4-108) states that y(t) is a function of x(¢) only, in Eq. (4-120), 
P,B = 0. Therefore, 


(4-119) 


Jit) = y2(t) = P,Ax(2) (4-121) 
Taking the time derivative of the last equation once again leads to 
alt) = s(t) = P,A2x(r) (4-122) 
with P,AB = 0. 
Repeating the procedure leads to 
Jn) = Y,(t) = P,A™!x(2) (4-123) 
with P,A"-2B = 0. Therefore, using Eq. (4-108), we have 
P, 
P,A 
y(t) = Px(t) = "I x(t) (4-124) 
P,A™"! 
or 
P, 
P,A 
P= : (4-125) 
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and P, should satisfy the condition 


P,B = P,AB=...=P,A"?B= 0 (4-126) 
Now taking the derivative of Eq. (4-108) with respect to time, we get 
y(t) = Px(t) = PAx(t) + PBr(t) (4-127) 
Comparing Eq. (4-127) with Eq. (4-110), we obtain 
A, = PAP"! (4-128) 
and 
B, = PB (4-129) 
Then, from Eq. (4-125), 
P.B 0 
P,AB 0 
pp=| - | =|- (4-130) 
P,A""'B 1 
Since P, is an 1 X m row matrix, Eq. (4-130) can be written 
P,(B AB A?B ... A™'BJ=[0 0... JJ (4-131) 
Thus P, is obtained as 
P,=—[0 0... 1B AB A?B ... A”'By! (4-132) 
=(0 0... 1S” 
if the matrix S=[B AB A?B_... A*'B) is nonsingular. This is the 


condition of complete state controllability. Once P, is determined from Eq. 
(4-132), the transformation matrix P is given by Eq. (4-125). 


EXAMPLE 4-8 Let a linear time-invariant system be described by Eq. (4-95) with 


1 —1] 1 
A= B= 4-133 
E —-1] 1 é ) 


It is desired to transform the state equation into the phase-variable canonical form. 

Since the matrix 
1 0 

S=[B AB] = b ‘| (4-134) 

is nonsingular, the system may be expressed in the phase-variable canonical form. 

Therefore, P; is obtained as a row matrix which contains the elements of the last row 
of S~'; that is, 

P,=[l —I] (4-135) 


TP] fi -1 ; 
P=|e4l=[, ri (4-136) 


Using Eq. (4-125), 
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Thus 


A, = PAP! = Fe "| (4-137) 


B, = PB = | tl (4-138) 

The method of defining state variables by inspection as described earlier 
with reference to Eq. (4-91) is inadequate when the right-hand side of the 
differential equation also includes the derivatives of r(t). To illustrate the point 
we consider the following example. 


EXAMPLE 4-9 Given the differential equation 


TO ss vo Jy aa) 4: S61) = ao 4 2r(t) (4-139) 


it is desired to represent the equation by three state equations. Since the right side of 
the state equations cannot include any derivatives of the input r( t), it is necessary to 
include r(t) when defining the state variables. Let us rewrite Eq. (4-139) as 


@e(t) — dr(t) cece dc(t) _ det) 


ae a qe ae 2c(t) + 2r(t) (4-140) 
The state variables are now defined as 
x,(1) = c(t) (4-141) 
— at) f 
x(t) = ai (4-142) 
2 
x(t) =F _ (4) (4-143) 


Using these last three equations and Eq. (4-140), the state equations are written 
ax,(t 
M1 — 50) 


PHO x50) + r(0) (4-144) 


as) — —2x,(t) = x2(t) — 5x3(t) a 3r(t) 


In general, it can be shown that for the nth-order differential equation 


n n-1 
we + a, oe Tee Gans a ve) 
; (4-145) 
_» art), d’-r(t) ar(t) 
Og tO Gere to + Ba SE + bert) 


the state variables should be defined as 
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x,(t) = c(t) — bor(t) 
des) _ 


x(t) = Air(t) 
Ly cB 
(4-146) 
x,(0 = GO — hr 
where 
h, = b, — a,b 
h, = (6, — abo) — a,h, 
= (b; a3b9) anh, ayhy, (4-147) 
h, = (b, — Ggdo) — Gn yhy — Aqeghy m2. — zh, — ayhy_, 


Using Eqs. (4-146) and (4-147), we resolve the nth-order differential equa- 
tion in Eq. (4-145) into the following m state equations: 


du) is X(t) + Ayr(t) 


tr) = x,(t) + har(2) 


dt 
(4-148) 
Poe) = x,(4) + Ayr) 
dit) = —a,X,(t) — d,-1X2(t) — 66. AX) ~ a: x,(0) + A,r) 


The output equation is obtained by rearranging the first equation of Eq. (4-146): 
c(t) = x,(t) + Bor) (4-149) 
Now if we apply these equations to the case of Example 4-9, we have 
a,=5 b, =90 b, =2 
a,=1 b,=0 
a,=2 b,=1 
h, = b, — a,b, = 90 
= (6, — a,b) — ah, = 1 
h, = (63 — @360) — a,h, — ayh, = - 3 
When we substitute these parameters into Eqs. (4-146) and (4-147), we have 
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the same results for the state variables and the state equations as obtained in 
Example 4-9, 

The disadvantage with the method of Eqs. (4-146), (4-147), and (4-148) 
is that these equations are difficult and impractical to memorize. It is not ex- 
pected that one will always have these equations available for reference. How- 
ever, we shall later describe a more convenient method using the transfer 
function. 


4.8 Relationship Between State Equations and Transfer Functions 


We have presented the methods of describing a linear time-invariant system 
by transfer functions and by dynamic equations. It is interesting to investigate 
the relationship between these two representations. 

In Eq. (3-3), the transfer function of a linear single-variable system is 
defined in terms of the coefficients of the system’s differential equation. Similar- 
ly, Eq. (3-16) gives the matrix transfer function relation for a multivariable 
system that has p inputs and g outputs. Now we shall investigate the transfer 
function matrix relation using the dynamic equation notation. 

Consider that a linear time-invariant system is described by the dynamic 
equations 


a) = Ax(/) + Br(s) (4-150) 
c(t) = Dx(s) + Er() (4-151) 


where 
x(t) = 1 X | state vector 


r(t) = p X 1 input vector 
c(t) = g X | output vector 


and A, B, D, and E are matrices of appropriate dimensions. 
Taking the Laplace transform on both sides of Eq. (4-150) and solving 
for X(s), we have 


X(s) = (sI — A)~!x(0+) + (sI — A)~'BR(s) (4-152) 
The Laplace transform of Eq. (4-151) is 
C(s) = DX(s) + ER(s) (4-153) 


Substituting Eq. (4-152) into Eq. (4-153), we have 
C(s) = D(sI — A)-'x(0+) + D(sI — A)-'BR(s) + ER(s) (4-154) 


Since the definition of transfer function requires that the initial conditions be 
set to zero, x(0-+) = 0; thus Eq. (4-154) becomes 


C(s) = [D(sI — A)-'B + E]R(s) (4-155) 
Therefore, the transfer function is defined as 
G(s) = DoI — A)'B+E (4-156) 


which is a g X p matrix. Of course, the existence of G(s) requires that the 
matrix (sl — A) is nonsingular. 
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EXAMPLE 4-10 Consider that a multivariable system is described by the differential 


equations 
d? d 
at + 4Gi — 3a = (4-157) 
d d 
a + a +e, + 2c. =1r2 (4-158) 
The state variables of the system are assigned as follows: 
x= (4-159) 
_ dey 
4 (4-160) 
X3 = C2 (4-161) 


These state variables have been defined by mere inspection of the two differential 
equations, as no particular reasons for the definitions are given other than that these 
are the most convenient. 

Now equating the first term of each of the equations of Eqs. (4-157) and (4-158) to 
the rest of the terms and using the state-variable relations of Eqs. (4-159) through 
(4-161), we arrive at the following state equation and output equation in matrix form: 


dt 
a2/_| 9 -4 3ix,/+/1 0 | (4-162) 


2 


aT) | o 1 elm 00 


= —1 -1 -2]|/ x; 0 1| 


x4 

c1]_[l 0 7 7 

[e|=[o 0 11% = Dx (4-163) 
x3 


To determine the transfer function matrix of the system using the state-variable 
formulation, we substitute the A, B, D, and E matrices into Eq. (4-156). First, we form 
the matrix (sI — A), 

s —l 0 
(sSI—A)=|0 s+4 —3 (4-164) 
1 1 s+2 
The determinant of (sI — A) is 


|sI — A| = s3 + 6s? + lls + 3 (4-165) 
Thus 
st+6s+11 s+2 3 
(sl — A)! = Tsai — AT —3 s(s + 2) 35 (4-166) 


—(s+4) —-(s+1) s(s+4) 
The transfer function matrix is, in this case, 
G(s) = D(sI — A)-'B 


2 1 st2 3 (4-167) 
~ $3 + 652 + lls + 3} —( +1) s(s +4). 


Using the conventional approach, we take the Laplace transform on both sides of 
Eqs. (4-157) and (4-158) and assume zero initial conditions. The resulting transformed 
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equations are written in matrix form as 


o +4 3 eo) = Bal aie 
Stl st2]LC.(s) Ris) 
Solving for C(s) from Eq. (4-168), we obtain 
C(s) = G(s)R(s) (4-169) 
where 
_fss+4 —-3 7 : 
eo =[ el (4-170) 


and the same result as in Eq. (4-167) is obtained when the matrix inverse is carried out. 


4.9 Characteristic Equation, Eigenvalues, and Eigenvectors 


The characteristic equation plays an important part in the study of linear 
systems. It can be defined from the basis of the differential equation, the trans- 
fer function, or the state equations. 

Consider that a linear time-invariant system is described by the differential 


equation 
d"c d""'c 
ae + % gear a, SE +. ce 
(4-171) 
be he i he OR 
° det” 1 d-t 15 
By defining the operator p as 
d* 
ko a = a 
ae a ee ee | (4-172) 
Eq. (4-171) is written 
"- ap") -+- agp"? +...-+a_.p+a,)c 
(p 1D 2P iP ) (4-173) 


= (bop"+ bypri+...+b1p+b,)r 

Then the characteristic equation of the system is defined as 
Ss” + as") + as™ 4+... +a,_,5+a,=0 (4-174) 

which is setting the homogeneous part of Eq. (4-173) to zero. Furthermore, the 


operator p is replaced by the Laplace transform variable s. 
The transfer function of the system is 


G(s) = Cs) — bos" + bys"! +... +b +8, 
Ris) s® + ays" +... 44,5 +a, 
Therefore, the characteristic equation is obtained by equating the denominator 
of the transfer function to zero. 
From the state-variable approach, we can write Eq. (4-156) as 


(4-175) 


G(s) = pa PB +e 


_ D{adj(sI — AJB + |sI — A|E 
ac |sI — Al] 


(4-176) 
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Setting the denominator of the transfer function matrix G(s) to zero, we get 
the characteristic equation expressed as 


|sI— Al =0 (4-177) 
which is an alternative form of Eq. (4-174). 


Eigenvalues 


The roots of the characteristic equation are often referred to as the eigen- 
values of the matrix A. It is interesting to note that if the state equations are 
represented in the phase-variable canonical form, the coefficients of the char- 
acteristic equation are readily given by the elements in the last row of the 
elements of the A matrix. That is, if A is given by Eq. (4-96), the characteristic 
equation is readily given by Eq. (4-174). 

Another important property of the characteristic equation and the eigen- 
values is that they are invariant under a nonsingular transformation. In other 
words, when the A matrix is transformed by a nonsingular transformation 
x = Py, so that 

A =P-'AP (4-178) 
then the characteristic equation and the eigenvalues of A are identical to those 
of A. This is proved by writing 

sl — A.= sl — P-'!AP (4-179) 
or 
sl — A= sP-'P — P-'AP (4-180) 
The characteristic equation of A is 
|sI — A| =|sP-1P — P-'AP| 

= |P-'(sI — A)P| 
Since the determinant of a product is equal to the product of the determinants, 
Eq. (4-181) becomes 

|sl — A] = |P-'||sI — A]|P| 
== |sI — A| 


(4-181) 


(4-182) 


Eigenvectors 
The n X I vector p, which satisfies the matrix equation 
(A. — A)p,; = 0 (4-183) 


where J, is the ith eigenvalue of A, is called the eigenvector of A associated with 
the eigenvalue /,;. [lustrative examples of how the eigenvectors of a matrix 
are determined are given in the following section. 


4.10 Diagonalization of the A Matrix (Similarity Transformation) 


One of the motivations for diagonalizing the A matrix is that if A is a diagonal 
matrix, the eigenvalues of A,/,,4,,...,A,, all assumed to be distinct, are 
located on the main diagonal; then the state transition matrix e’' will also be 
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diagonal, with its nonzero elements given by e*", e#*,..., e*". There are other 
reasons for wanting to diagonalize the A matrix, such as the controllability of 
a system (Section 4.15). We have to assume that all the eigenvalues of A are 
distinct, since, unless it is real and symmetric, A cannot always be diagonalized 
if it has multiple-order eigenvalues. 

The problem can be stated as, given the linear system 


x(t) = Ax(t) + Bu(t) (4-184) 
where x(t) is an n-vector, u(t) an r-vector, and A has distinct eigenvalues J,, 
Ax... , Aq it is desired to find a nonsingular matrix P such that the transfor- 
mation 
x(t) = Py(t) - (4-185) 
transforms Eq. (4-184) into 
ya) = Ay(t) + Tus) (4-186) 
with A given by the diagonal matrix 
A, O O ... O 
0 A, O 0 
A=/0 0 Ad; ... O (n Xn) (4-187) 
woheetelahgedlatise debt due 0 
0 0 O an 


This transformation is also known as the similarity transformation. The state 
equation of Eq. (4-186) is known as the canonical form. 
Substituting Eq. (4-185) into Eq. (4-184) it is easy to see that 


A = P-'AP (4-188) 
and 
IT=P'B (2 xr) (4-189) 


In general, there are several methods of determining the matrix P. We show 
in the following that P can be formed by use of the eigenvectors of A; that is, 


P=([P, PP. Ps... Pal (4-190) 


where p, (= 1, 2,...,) denotes the eigenvector that is associated with the 
eigenvalue J,. This is proved by use of Eq. (4-183), which is written 


Ap, = Ap, i=1,2,...,” (4-191) 
Now forming the n x n matrix, 
{A:p, A.p..-.A,P,] =[Ap,; Ap.... Ap,] 


4-192 
=A[p, P--- Pl ‘ , 


or 
[P: P2---PJA= Alp, P2...p,] (4-193) 
Therefore, if we let 
P=[P. P2--- Pal (4-194) 
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Eq. (4-193) gives 
PA = AP (4-195) 


or 
A =P "'AP (4-196) 


which is the desired transformation. 
If the matrix A is of the phase-variable canonical form, it can be shown that 
the P matrix which diagonalizes A may be the Vandermonde matrix, 


el WO eo 
A, oA, A, 
2 2 2 
pP=| “' . a se (4-197) 
PAD! Ay Aa} 
where J,, A,,..., A, are the eigenvalues of A. 


Since it has been proven that P contains as its columns the eigenvectors 
of A, we shall show that the ith column of the matrix in Eq. (4-197) is the 


eigenvector of A that is associated with 4,,i=1,2,...,H. 
Let 
Pi 
Pi2 
B=| ° (4-198) 
Din 
be the ith eigenvector of A. Then 
(A, — A)p,; = 0 (4-199) 
or 
- A; —1 0 0 0 al Pa i 
0 a -!i1 0 0 Pia 
0 0 A —l 0 
: =0 (4-200) 
0 0 0 Q: Gan —1 . 
Ae hyn Met? Gye ce AP OIL Pa 
This equation implies that 
AiPu — Pia = 9 
A: Piz — is = 9 
(4-201) 


Ai Pin-1 = Pin = 9 
Q,Pi + Qn-1 Pin t+... + (A; + 41) Pin = 9 
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Now we arbitrarily let p,, = 1. Then Eq. (4-201) gives 


Po =; 
Dis = A} 
(4-202) 
Pin-1 = Ar? 
Pin = Ar} 


which represent the elements of the ith column of the matrix in Eq. (4-197). 
Substitution of these elements of p, into the last equation of Eq. (4-201) simply 
verifies that the characteristic equation is satisfied. 


EXampPLe 4-11 Given the matrix 


0 1 0 
A= 0 0 1 (4-203) 
—-6 -11 —6 
which is the phase-variable canonical form, the eigenvalues of A are A, = -1, 
A, = —2, a3; = —3. The similarity transformation may be carried out by use of the 
Vandermonde matrix of Eq. (4-197). Therefore, 
1 1 1 [ 4 1 1 
P=/A, 4, A,;|/=/—-1 -—2 —3 (4-204) 
220 AB OB | 1 4 9 


The canonical-form state equation is given by Eq. (4-186) with 


—1 0 0 A, 0 0 
A=P"!AP=| 0 —2 O;=|/0 aA, O (4-205) 
0 0 -3 0 0 A; 


EXAmpLe 4-12 Given the matrix 


0 1 -l 
A=/-6 —1l1 6 (4-206) 
—-6 —l1 5 
it can be shown that the eigenvalues of A are 2, = —1,A, = —2, and A; = —3. It 


is desired to find a nonsingular matrix P that will transform A into a diagonal matrix 
A, such that A = P-1AP, 

We shall follow the guideline that P contains the eigenvectors of A. Since A is not 
of the phase-variable canonical form, we cannot use the Vandermonde matrix. 


Let the eigenvector associated with A, = —1 be represented by 
Pr 
Pi =| Pas (4-207) 
P31 


Then p; must satisfy 
(Ail — A)p, = 0 (4-208) 
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or 
Ay —1 1 P11 
6 A, +11 —6 P21 |=9 (4-209) 
6 11 A, — SL ps1 


The last matrix equation leads to 
—Pit — Pai + P31 =0 
6711 + 10p21 — 6p31 = 0 (4-210) 
6p11 + 11p21 — 6p31 = 0 
from which we get p2, = 0 and pi; = p3;. Therefore, we can let pi; == p3; = 1, and 


get 
1 
Pi =| 0 (4-211) 
1 
For the eigenvector associated with 1, = —2, the following matrix equation 
must be satisfied: 
Ar —1 1 P12 
6 Agtil —6 |} par|=90 (4-212) 


6 11 A, —5 P32 
or 
—2p12 — Pr2 + p32 = 90 


6712 + 9p22 — 6p32 = 0 (4-213) 
6pi2 + Wp22 — 7Tp32 = 0 
In these three equations we let pj. = 1; then p22 = 2 and p32 = 4. Thus 


1 
P2 =| 2 (4-214) 
4 
Finally, for the eigenvector p3;, we have 
A3 —1 1 Pi3 
6 A3s+11 —6 P23 |=90 (4-215) 


6 11 A3 —5 P33 
or 
—3pi13 — P23 + p33 = 90 
6713 + 8p23 — 6p33 = 0 (4-216) 
6713 + 11p23 — 8p33 = 90 
Now if we arbitrarily let p,; = 1, the last three equations give p.; = 6 and p33 = 9. 


Therefore, 
1 


P3 =| 6 (4-217) 
9 
The matrix P is now given by 


(4-218) 


on 


1 1 
P=[p; po D3] =/0 2 
1 4 
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It is easy to show that 


1 9 O —1 0 0 
a-rvar-| Ar o|- 0 —2 0 (4-219) 


0 0 A; 


4.11. Jordan Canonical Form 


In general when the A matrix has multiple-order eigenvalues, unless the 
matrix is symmetric and has real elements, it cannot be diagonalized. However, 
there exists a similarity transformation 


A=P"'AP (nxn) (4-220) 
such that the matrix A is almost a diagonal matrix. The matrix A is called the 


Jordan canonical form. Typical Jordan canonical forms are shown in the fol- 
lowing examples: 


4, 1 0:0 07 
0 4 1:0 0 
A=/0 0 4,:0 0 (4-221) 
0 0 O'4,: 0 
0 0 0 | 
4 150 0 07 
0 4:0 0 0 
A=|0 0'2,:0 0 (4-222) 
| 0 0 014,10 
0 0 0 034A, | 


The Jordan canonical form generally has the following properties: 


1. The elements on the main diagonal of A are the eigenvalues of the 
matrix. 

2. All the elements below the main diagonal of A are zero. 

3. Some of the elements immediately above the multiple-ordered 
eigenvalues on the main diagonal are Is, such as the cases illustrated 
by Eqs. (4-221) and (4-222). 

4. The 1s, together with the eigenvalues, form typical blocks which 
are called Jordan blocks. In Eqs. (4-221) and (4-222) the Jordan 
blocks are enclosed by dotted lines. 

5. When the nonsymmetrical A matrix has multiple-order eigenvalues, 
its eigenvectors are not linearly independent. For ann x n A, there 
is only r (r < n) linearly independent eigenvectors. 

6. The number of Jordan blocks is equal to the number of independent 
eigenvectors, r. There is one and only one linearly independent 
eigenvector associated with each Jordan block. 

7. The number of 1s above the main diagonal is equal ton — r. 
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The matrix P is determined with the following considerations. Let us as- 
sume that A has q distinct eigenvalues among n eigenvalues. In the first place, 
the eigenvectors that correspond to the first-order eigenvalues are determined 
in the usual manner from 

(Al — A)p, = 0 (4-223) 
where 4, denotes the th distinct eigenvalue, i = 1, 2,..., 4. 

The eigenvectors associated with an mth-order Jordan block are deter- 

mined by referring to the Jordan block being written as 


AAO hats 10 
OE vk: 20 
ahecnati nist: (m x m) (4-224) 
00... 4 1 
GO. sens, A 


where J, denotes the jth eigenvalue. 
Then the following transformation must hold: 


A; I 0 eee 0 
0 Aa, I 0 
[Py Px asco Pall agdeewwadnen ts . |=Al[P: Po --- Pal (4-225) 
0 0 A, 1 
0 0. ...... A; 
or 
A;Pi = AP, 


Pi + AP. = Ap, 
Po + ADs = Ap, 


(4-226) 


Pr—1 + APm = APn 
The vectors p,,P2,..- Pm are determined from these equations, which can 


also be written 


(A,L — A)p, = —P, 


(jl e A)P; = —P2 (4-227) 


(AjI — A)Pn = —Pm-1 
EXAMPLE 4-13 Given the matrix 


0 6 —5 
A=!/1 0 2 (4-228) 
3 2 4 
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the determinant of AI — A is 


A -6 5 
AI — Aj =| —1 A -2 }=A3—4)24 51-2 
| | ee er (4-229) 


= (A — 2)A — 1)? 
Therefore, A has a simple eigenvalue at 1, = 2 and a double eigenvalue at A, = 1. 
To find the Jordan canonical form of A involves the determination of the matrix 
P such that A = P-!AP. The eigenvector that is associated with A, = 2 is deter- 
mined from 


(A,I — A)p, = 0 (4-230) 
Thus 
2 —6 5 Pit 
-1 2 -—2 Pu|=0 (4-231) 
-3 -2 -—2 P3t 
Setting p:; = 2 arbitrarily, the last equation gives p., = —1 and p3; = —2. There- 
fore, 
2 
Bi =| —1 (4-232) 
—2 


For the eigenvector associated with the second-order eigenvalue, we turn to Eq. 
(4-227). We have (the two remaining eigenvectors are p, and p3) 
(A,I — A)p2 = 0 (4-233) 
and 
(A2I — A)ps = —DP2 (4-234) 
Equation (4-233) leads to 
1 —6 5 Pi2 


—1 1 —2]| p2r|=o0 (4-235) 
—3 -—2 ~—3]| ps2 
Setting p12 = 1 arbitrarily, we have p2. = —4 and p3;, = —3. Thus 
1 
Pa =| —4 (4-236) 
+4 
Equation (4-234), when expanded, gives 
1 -6 ~—S5S][pi3 —1 
-1 1 —2]|po3xl=| 4 (4-237) 
—3 -—2 —3]Lpss 5 
from which we have 
P13 1 
Ps =| Pas | =| —34 (4-238) 
P33 —4#§ 
Thus 
2 1 1 
P=|-—-1 —3 —3 (4-239) 
“2-4 48 
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The Jordan canonical form is now obtained as 


1 (4-240) 
1 


Note that in this case there are two Jordan blocks and there is one element of unity 
above the main diagonal of A. 


4.12 State Diagram 


The signal flow graph discussed in Section 3.5 applies only to algebraic equations. 
In this section we introduce the methods of the state diagram, which represents 
an extension of the signal flow graph to portray state equations and differential 
equations. The important significance of the state diagram is that it forms a 
close relationship among the state equations, state transition equation, com- 
puter simulation, and transfer functions. A state diagram is constructed fol- 
lowing all the rules of the signal flow graph. Therefore, the state diagram may 
be used for solving linear systems either analytically or by computers. 


Basic Analog Computer Elements 


Before taking up the subject of state diagrams, it is useful to discuss the 
basic elements of an analog computer. The fundamental linear operations that 
can be performed on an analog computer are multiplication by a constant, 
addition, and integration. These are discussed separately in the following. 


Multiplication by a constant. Multiplication of a machine variable by a 
constant is done by potentiometers and amplifiers. Let us consider the opera- 
tion 

x,(t) = ax,(t) (4-241) 


where a is a constant. If a lies between zero and unity, a potentiometer is used 
to realize the operation of Eq. (4-241). An operational amplifier is used to simu- 
late Eq. (4-241) if a is a negative integer less than —1. The negative value 
of a considered is due to the fact that there is always an 180° phase shift between 
the output and the input of an operational amplifier. The computer block 
diagram symbols of the potentiometer and the operational amplifier are shown 
in Figs. 4-5 and 4-6, respectively. 


x, @) x2 (t) x1) X(t) 


x2 (1) =ax, (9) O0<a<1 X9(t) = ax, (t) a<-1] 


Fig. 4-5. Analog-computer block-diagram Fig. 4-6. Analog-computer block diagram 
symbol of a potentiometer. of an operational amplifier. 
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Algebraic sum of two or more variables. The algebraic sum of two or more 
machine variables may be obtained by means of the operational amplifier. 


Amplification may be accompanied by algebraic sum. For example, Fig. 4-7 


x, (t) 


x4 (t) 


X4(t) = ay x, (t) +ayx2(t) +.a3x3(0) 


Fig. 4-7. Operational amplifier used as a summer. 
illustrates the analog computer block diagram of a summing operational am- 
plifier which portrays the following equation: 
X4(t) = a,x,(t) + a,x,(¢) + a5x,(t) (4-242) 
Integration. The integration of a machine variable on an analog computer 
is achieved by means of a computer element called the integrator. If x,(z) is the 


output of the integrator with initial condition x,(f,) given at t = ft, and x,(f) 
is the input, the integrator performs the following operations: 


xi) = f "ax,(t) dt + x(t) a<l (4-243) 
The block diagram symbol of the integrator is shown in Fig. 4-8. The integrator 


can also serve simultaneously as a summing and amplification device. 


x4 (tg) 


x4 (t) 
x, (t) 


t 
x, (= J axX4(T)dT + x4 (to) 
0 


Fig. 4-8. Analog computer block diagram of an integrator. 


We shall now show that these analog computer operations can be portrayed 
by signal flow graphs which are called state diagrams because the state vari- 
ables are involved. 


First consider the multiplication of a variable by a constant; we take the 
Laplace transform on both sides of Eq. (4-241). We have 


X,(s) = aX,(s) (4-244) 
The signal flow graph of Eq. (4-244) is shown in Fig. 4-9. 
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x, (t) 


a 


—— OO 
x(t) x4 (t) 
X,(s) X4(s) X3(s) 
Fig. 4-9. Signal-flow-graph Fig. 4-10. Signal-flow-graph rep- 
representation of x2(t) = resentation of x4(1) = a,x1(t) 
ax,(t) or X2(s) = aX4(s). + a2x2(t) + a3x3(1) or X4(s) = 


a, X4(s) + a2X2(s) + ag X3(s). 


For the summing operation of Eq. (4-242), the Laplace transform equation 

is 
X (5) = a, X,(s) + a,X,(5) + a3X3(5) (4-245) 

The signal-flow-graph representation of the last equation is shown in Fig. 4-10. 
It is important to note that the variables in the signal flow graphs of Figs. 4-9 
and 4-10 may be in the time domain or the Laplace transform domain. Since 
the branch gains are constants in these cases, the equations are algebraic in 
both domains. 

For the integration operation, we take the Laplace transform on both sides 
of Eq. (4-243). In this case the transform operation is necessary, since the signal- 
flow-graph algebra does not handle integration in the time domain. We have 


X,(5) = a& ( x(t) ar] + Eilts) 


=a ( | x(t) dt — ) : x,(t) ar] + 2ilto) (4-246) 


= axe) a Xilto) a i x,(t) ar| 


However, since the past history of the integrator is represented by x,(t)), and 
the state transition starts from t = fy, x,(r) =0 for 0< +t < ¢. Thus Eq. 
(4-246) becomes 


X(s) =O 4 BO) a1, (4-247) 


It should be emphasized that Eq. (4-247) is defined only for the period 1 > fy. 
Therefore, the inverse Laplace transform of X,(s) in Eq. (4-247) will lead to 
x,(t) of Eq. (4-243). 

Equation (4-247) is now algebraic and can be represented by a signal 
flow graph as shown in Fig. 4-11. An alternative signal flow graph for Eq. 
(4-247) is shown in Fig. 4-12. 
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Xx, (tg) 
19 x1 (tg) 
Ss 
\ 1 
a scl as-} 
X16) 

X(s) X,(s) X4(s) 
Fig. 4-11. Signal-flow-graph representation of Fig. 4-12. Signal-flow-graph rep- 
X1(s) = [aX 2(s)/s] + [x1(to)/s] resentation of X\(s) = [aX2(s)/s] 


+ [x1(to)/s]. 


Thus we have established a correspondence between the simple analog 
computer operations and the signal-flow-graph representations. Since, as shown 
in Fig. 4-12, these signal-flow-graph elements may include initial conditions 
and can be used to solve state transition problems, they form the basic elements 
of the state diagram. 

Before embarking on several illustrative examples on state diagrams, let 
us point out the important usages of the state diagrams. 


1. A state diagram can be constructed directly from the system’s 


differential equation. This allows the determination of the state 
variables and the state equations once the differential equation of 
the system is given. 


. A state diagram can be constructed from the system’s transfer 


function. This step is defined as the decomposition of transfer 
functions (Section 4,13). 


. The state diagram can be used for the programming of the system 


on an analog computer. 


. The state diagram can be used for the simulation of the system on 


a digital computer. 


. The state transition equation in the Laplace transform domain 


may be obtained from the state diagram by means of the signal- 
flow-graph gain formula. 


. The transfer functions of a system can be obtained from the state 


diagram. 


. The state equations and the output equations can be determined 


from the state diagram. 


The details of these techniques are given below. 


From Differential Equation to the State Diagram 


When a linear system is described by a high-order differential equation, a 
state diagram can be constructed from these equations, although a direct 
approach is not always the most convenient. Consider the following differential 
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equation: 
de aie 
dt” aa 
In order to construct a state diagram using this equation, we rearrange the equa- 
tion to read 


+a aa +a, H+ Che we (4-248) 


d"c d"™"'c dc 
= —-a,5 ee OO ar 4-24 
dt" a ee Qy-1 at n : ( 9) 
O° (o) e) e e ° [@) [e) 
s"C s?-1C gs? 2C sC Cc 
(a) 
sn-1C gn 2 sc C 


c®-D(ty) c"-2)(t0) cM(ty) (to) 


(c) 
Fig. 4-13. State diagram representation of the differential equation of Eq. 
(4-248). 
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Let us use the following symbols to simplify the representation of the 
derivatives of c: 


» _ dic : 
eae GS 452008 (4-250) 
Frequently, ¢ in the literature, is used to represent dc/dt. 
Now the variables r, c, ¢, c®,..., c™ are represented by nodes arranged 


as shown in Fig. 4-13(a). In terms of Laplace transform, these variables are 
denoted by R(s), C(s), sC(s), s?C(s),..., s"C(s), respectively. 

As the next step, the nodes in Fig. 4-13(a) are connected by branches to 
portray Eq. (4-249). Since the variables c” and c“-" are related through in- 
tegration with respect to time, they can be interconnected by a branch with gain 
s~! and the elements of Figs. 4-11 and 4-12 can be used. Therefore, the com- 
plete state diagram is drawn as shown in Fig. 4-13(c). 

When the differential equation is that of Eq. (4-145), with derivatives of 
the input on the right side, the problem of drawing the state diagram directly 
is not so straightforward. We shall show later that, in general, it is more con- 
venient to obtain the transfer function from the differential equation first and 
then obtain the state diagram through decomposition (Section 4.13). 


Example 4-14 Consider the following differential equation: 
2 
oo43% 420-7 (4-251) 


Equating the highest-ordered term of Eq. (4-251) to the rest of the terms, we have 


d*c _ de 

a —2c 3h +r (4-252) 
Following the procedure outlined above, the state diagram of the system is shown in 
Fig. 4-14. 


Oo cM(tg+) O c(tg +) 


Fig. 4-14. State diagram for Eq. (4-251). 


From State Diagram to Analog Computer Block Diagram 


It was mentioned earlier that the state diagram is essentially a block dia- 
gram for the programming of an analog computer, except for the phase reversal 
through amplification and integration. 
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Exampte 4-15 An analog computer block diagram of the system described by Eq. 
(4-251) is shown in Fig. 4-15. The final practical version of the com- 
puter block diagram for programming may be somewhat different 

from shown, since amplitude and time scaling may be necessary. 


Fig. 4-15. Analog-computer block diagram for the system described by 
Eq. (4-251). 


From State Diagram to Digital Computer Simulation 


The solution of differential equations by FORTRAN on the digital com- 
puter has been well established. However, from the standpoint of programming, 
a convenient way of modeling a system on the digital computer is by CSMP 
(Continuous System Modeling Program).?? In many respects CSMP serves the 
same purpose as an analog computer program, except that the scaling problem 
is practically eliminated. The state diagram or the state equations form a 
natural basis for the solution by CSMP. The following examples illustrate 
typical CSMP statements for the mathematical equations listed: 


Mathematical Equations CSMP Statements 
C = A,X, + Q2X2 C= Al*x XI] + A2* X2 
= *1 = 
=> Y= X1/2. 
x= f " x(t) dt + x,(0) ¥1 = INTGRL(X2, X10) 
0 
EXAMPLE 4-16 From the state diagram of Fig. 4-14, the following equations are 
written: 
c= fed (4-253) 
z j édt (4-254) 


€=r—3¢—2c (4-255) 
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Let the variables of these equations be denoted by 


c=C c(0) = 
¢=Cl ¢(0) = C10 
é=C2 

r=R 


on the CSMP. Then the main program of the CSMP representation of the system is 
given as follows: 


C = INTGRL (Cl, C0) (4-256) 
C1 = INTGRL (C2, C10) (4-257) 
C2 = R—3.* C1 ~—2.*C (4-258) 


From State Diagram to the State Transition Equation 


We have shown earlier that the Laplace transform method of solving the 
state equation requires the carrying out of the matrix inverse of (sI — A). 
With the state diagram, the equivalence of the matrix inverse operation is carried 
out by use of the signal-flow-graph formula. 

The state transition equation in the Laplace transform domain is 


X(s) = (sI — A)~'x(tg) + (sI — A)~'BR(s) t> fy (4-259) 
Therefore, the last equation can be written directly from the state diagram by 


use of the gain formula, with X,(s), i= 1,2,...,, as the output nodes, and 
xAtg), i= 1,2,...,n, and R,(s), 7 = 1,2,...,p, as the input nodes. 


EXAMPLE 4-17 Consider the state diagram of Fig. 4-14. The outputs of the inte- 
grators are assigned as state variables and the state diagram is 
redrawn as shown in Fig. 4-16. 


O X2(tgt+) QO x; (fot) 


Fig. 4-16. State diagram for Eq. (4-251). 


Applying the gain formula to the state diagram in Fig. 4-16, with X,(s) and 
X2(s) as output nodes, x,(¢$), x2(¢§), and R(s) as eae nodes, we have 


Xi(s) sae: + 5 xalts) +55 RO) (4-260) 


X2(s) = =o — x1(¢8) +7- alts) +" 7 — R(s) (4-261) 
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where 
A =1 + 3s7! + 2572 (4-262) 
After simplification, Eqs. (4-260) and (4-261) are presented in matrix form: 
1 
XG) s+3 1)] x3) GLihG. Dd 
= GENTS + er Dis 2) R(s) (4-263) 
X1(s) —2  5}} x2(tg) . 


(+ Is + 2) 
The state transition equation for t > to is obtained by taking the inverse Laplace 
transform on both sides of Eq. (4-263). 

Consider that the input r(t) is a unit step function applied at t = tf). Then the 
following inverse Laplace transform relationships are identified : 


£-1(4) = u(t = 10) t>t0 (4-264) 
£1 (; = ;) = ely (t — to) tty (4-265) 


The inverse Laplace transform of Eq. (4-263) is 
x(t) Qe-lt-ta) — g-2(t-t0) en te) — 920-80) Tx (te) 
ioe = Ee +b Qen2l-te) — _g- (t-te) 4. Sena E | 
1 — fp) — ev tet) 4 1d e-2(-t0) 
(i. aan 


(4-266) 
em t-te) — e-2(-to) 


The reader should compare this result with that of Eq. (4-77), obtained for ¢ > 0. 


From State Diagram to Transfer Function 


The transfer function between an input and an output is obtained from the 
state diagram by setting all other inputs and all initial states to zero. 


EXAMPLE 4-18 Consider the state diagram of Fig. 4-16. The transfer function 
C(s)/R(s) is obtained by applying the gain formula between these 
two nodes and setting x;(¢3) = 0 and x3(t}) == 0. Therefore, 


CG) 2 


R(s) ss? +3s+4+2 (28) 
The characteristic equation of the system is 
s?+35+2=0 (4-268) 


From State Diagram to the State Equations 


When the state diagram of a system is already given, the state equations 
and the output equations can be obtained directly from the state diagram by 
use of the gain formula. Some clarification seems necessary here, since the 
state transition equations are determined from the state diagram by use of 
the gain formula. However, when writing the state transition equations from 
the state diagram, the state variables, X,(s), i = 1, 2,..., “, are regarded as the 
output nodes, and the inputs, R,(s),j=1,2,...,p, and the initial states, 
x{t,),i = 1,2,...,n, are regarded as the input nodes. Furthermore, the state 
transition equations, as written directly from the state diagram, are necessarily 
in the Laplace transform domain. The state transition equations in the time 
domain are subsequently obtained by taking the inverse Laplace transform. 
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The left side of the state equation contains the first-order time derivative 
of the state variable x,(). The right side of the equation contains the state 
variables and the input variables. There are no Laplace operator s or initial 
state variables in a state equation. Therefore, to obtain state equations from 
the state diagram, we should disregard all the initial states and all the integrator 
branches with gains s~!. To avoid confusion, the initial states and the branches 
with the gain s~! can actually be eliminated from the state diagram. The state 
diagram of Fig. 4-16 is simplified as described above, and the result is shown in 
Fig. 4-17. Then, using x, and x, as output nodes and x,, x,, and r as input nodes, 


1 | 


Fig. 4-17. State diagram of Fig. 4-16 with the initial states and the integra- 
tor branches eliminated. 


and applying the gain formula between these nodes, the state equations are 
written directly: 


(4-269) 


EXAMPLE 4-19 As another example of illustrating the determination of the state 
equations from the state diagram, consider the state diagram shown 
in Fig. 4-18(a). This illustration will emphasize the importance of 

using the gain formula. Figure 4-18(b) shows the state diagram with the initial states 


a 


X9 (tot) x1 (tot) 


(a) 
Fig. 4-18. (a) State diagram. 
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(b) 


Fig. 4-18 (Cont.). (b) State diagram in (a) with all initial states and inte- 
grators eliminated. 


and the integrators being eliminated. Notice that in this case the state diagram in Fig. 
4-18(b) still contains a loop. Applying the gain formula to the diagram of Fig. 4-18(b) 
with X,, x2, and x3 as the output node variables and r, x;, x2, and x3 as the input 
nodes, the state equations are determined as follows: 


dx, 


dx, |_| ~(@2 +43) _ 1 ~ aoa | a 
7a el i a ee oral cd (4-270) 
dx3 | 


4.13 Decomposition of Transfer Functions 


Up until this point, various methods of characterizing a linear system have 
been presented. It will be useful to summarize briefly and gather thoughts at 
this point, before proceeding to the main topics of this section. 

It has been shown that the starting point of the description of a linear 
system may be the system’s differential equation, transfer function, or dynamic 
equations, It is demonstrated that all these methods are closely related. Further, 
the state diagram is shown to be a useful tool which not only can lead to the 
solutions of the state equations but also serves as a vehicle of translation from 
one type of description to the others. A block diagram is drawn as shown in 
Fig. 4-19 to illustrate the interrelationships between the various loops of de- 
scribing a linear system. The block diagram shows that starting, for instance, 
with the differential equation of a system, one can get to the solution by use of 
the transfer function method or the state equation method. The block diagram 
also shows that the majority of the relationships are bilateral, so a great deal 
of flexibility exists between the methods. 
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Dynamic 
equations 


Differential 
equations 


State 
transition 
equation 


Transfer 
function 


Fig. 4-19. Block diagram showing the relationships among various 
methods of describing linear systems. 


One step remains to be discussed. This involves the construction of the 
state diagram from the transfer function. In general, it is necessary to establish 
a better method than using Eqs. (4-146) through (4-148) in getting from a 
high-order differential equation to the state equations. 

The process of going from the transfer function to the state diagram or the 
state equations is called the decomposition of the transfer function. In general, 
there are three basic ways of decomposing a transfer function: direct decomposi- 
tion, cascade decomposition, and parallel decomposition. Each of these three 
schemes of decomposition has its own advantage and is best suited for a par- 
ticular situation. 


Direct Decomposition 


The direct decomposition scheme is applied to a transfer function that 
is not in factored form. Without loss of generality, the method of direct de- 
composition can be described by the following transfer function: 


C(s) __ ays? + ays + ay, j 
R(s) bys? + bys + b, Ca) 


The objective is to obtain the state diagram and the state equations. The fol- 
lowing steps are outlined for the direct decomposition: 


I. Alter the transfer function so that it has only negative powers 
of s. This is accomplished by multiplying the numerator and the 
denominator of the transfer function by the inverse of its highest 
power in s. For the transfer function of Eq. (4-271), we multiply 
the numerator and the denominator of C(s)/R(s) by s~?. 

2. Multiply the numerator and the denominator of the transfer func- 
tion by a dummy variable X(s). Implementing steps | and 2, Eq. 
(4-271) becomes 


COs) _ ao + ais"! + ays"? X(5) 
R(s) by + bys"! + bys"? X(s) (rei) 


3. The numerators and the denominators on both sides of the transfer 
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function resulting from steps 1 and 2 are equated to each other, 
respectively. From Eq. (4-272) this step results in 


C(s) = (ay + ays7! + a,s~*)X(s) (4-273) 
R(s) = (bp + B,871 + by877)X(5) (4-274) 


4. In order to construct a state diagram using these two equations, 
they must first be in the proper cause-and-effect relation. It is ap- 
parent that Eq. (4-273) already satisfies this prerequisite. However, 
Eq. (4-274) has the input on the left side and must be rearranged. 
Dividing both sides of Eq. (4-274) by b, and writing X(s) in terms of 
the other terms, we have 


X(s) = fe R(s) — z s-1X(s) — 2 57? X(s) (4-275) 


The state diagram is now drawn in Fig. 4-20 using the expressions in 
Eqs. (4-273) and (4-275). For simplicity, the initial states are not drawn on the 


diagram. As usual, the state variables are defined as the outputs of the integra- 
tors. 


— by/bo 


Fig. 4-20. State diagram for the transfer function of Eq. (4-271) by direct 
decomposition. 


Following the method described in the last section, the state equations are 
written directly from the state diagram: 


om 0 fe | hae 0 

al ee ad (4-276) 
dx} |= xb}, ) ji)" 

dt by Bo by 


The output equation is obtained from Fig. 4-20 by applying the gain for- 
mula with c(t) as the output node and x,(r), x,(¢), and r(¢) as the input nodes. 


= (oti) (a SB)seeg, am 
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Cascade Decomposition 


Cascade decomposition may be applied to a transfer function that is in 
the factored form. Consider that the transfer function of Eq. (4-271) may be 
factored in the following form (of course, there are other possible combinations 
of factoring): 

C(s)_ ag 8 +2,5+2, s 

Ris) bp S + py 8 -+ Pp ee) 
where z,, Z,, ,, and p, are real constants. Then it is possible to treat the func- 
tion as the product of two first-order transfer functions. The state diagram of 
each of the first-order transfer functions is realized by using the direct de- 
composition method. The complete state diagram is obtained by cascading the 
two first-order diagrams as shown in Fig. 4-21. As usual, the outputs of the 


Pi ~P2 


Fig. 4-21, State diagram of the transfer function of Eq. (4-278) by cascade 
decomposition. 


integrators on the state diagram are assigned as the state variables. The state 
equations are written in matrix form: 


d. 
os ~P2 41 ~ Pil rs os 
= +) °° ir (4-279) 
ax, 0 — a 
dt Pi X2 b 


The output equation is 
C= @ — Paes + Gi — pide + Gtr (4-280) 


The cascade decomposition has the advantage that the poles and zeros of 
the transfer function appear as isolated branch gains on the state diagram. 
This facilitates the study of the effects on the system when the poles and zeros 
are varied. 


Parallel Decomposition 


When the denominator of a transfer function is in factored form, it is 
possible to expand the transfer function by partial fractions. Consider that a 
second-order system is represented by the following transfer function: 

C(s) _ P(s) 
R(s) (8 + pis + pa) 
where P(s) is a polynomial of order less than 2. We assume that the poles p, 


(4-281) 
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and p, may be complex conjugate for analytical purposes, but it is difficult to 
implement complex coefficients on the computer. 

In this case if p, and p, are equal it would not be possible to carry out a 
partial-fraction expansion of the transfer function of Eq. (4-281). With p, and 
P, being distinct, Eq. (4-281) is written 


C(s) K, K, 
RG) 54P1 | SPs Wore 
where K, and K, are constants. 
The state diagram for the system is formed by the parallel combination of 
the state diagram representation of each of the first-order terms on the right 
side of Eq. (4-282), as shown in Fig. 4-22. The state equations of the system are 


written 
ae —p, 9 ] xy 1 
= +| od (4-283) 
ce er ee 1 
at Dp 2 X2 


Ro) 


— Pp, 


Fig. 4-22. State diagram of the transfer function of Eq. (4-281) by parallel 
decomposition. 


The output equation is 


c=[K, K,] S| (4-284) 
X2 

One of the advantages of the parallel decomposition is that for transfer 
functions with simple poles, the resulting A matrix is always a diagonal matrix. 
Therefore, we can consider that parallel decomposition may be used for the 
diagonalization of the A matrix. 

When a transfer function has multiple-order poles, care must be taken 
that the state diagram, as obtained through the parallel decomposition, con- 
tain the minimum number of integrators. To further clarify the point just made, 
consider the following transfer function and its partial-fraction expansion: 
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Cis) _ 2s? +6s+5 _ 1 zc se ee 
R(s)” (s+ 1)%(s +2)” (841) 6 5415 542 
Note that the transfer function is of the third order, and although the total order 
of the terms on the right side of Eq. (4-285) is four, only three integrators should 
be used in the state diagram. The state diagram for the system is drawn as shown 
in Fig. 4-23. The minimum number of three integrators are used, with one in- 


(4-285) 


Fig. 4-23. State diagram of the transfer function of Eq. (4-285) by 
paralled decomposition. 


tegrator being shared by two channels. The state equations of the system are 


| written 
ax, = 

| tae: 1 1 0 xy 0 
ces Sa oe ae Sea (4-286) 
dx 


- 0 0 —2|Ilx; 1 


Therefore, the A matrix is of the Jordan canonical form. 


4.14 Transformation into Modal Form 


When the A matrix has complex eigenvalues it may not be possible to trans- 
form it into a diagonal matrix with real elements. To facilitate computer com- 
putation, it is desirable to avoid matrices with complex elements. When A has 
complex eigenvalues, in general, the matrix can be transformed into a non- 
diagonal matrix which is called the modal form by the transformation 


A = P-1AP (4-287) 


Let us assume that A is 2 x 2 and has eigenvalues A, == 0 + jw and 4, =o 
— jw. Then the modal-form matrix is given by 
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A =( . ° | (4-288) 
—-o ¢G 

The elements of the P matrix may be determined by brute force using Eqs. 
(4-287) and (4-288). If A has m real distinct eigenvalues in 1,,2,,...,A,, and 
n sets of complex-conjugate eigenvalues in 4, =o0,;+ jw; i= 1,2,...,7, 
the modal-form matrix is given by 


ra, O ... 0:0 0 0 
0 A, 0:90 0 0 
0 ini 0 0 ... 0 
A =} ----------------- Pirates aiaeiaimalaa (4-289) 
0 0 O:'A, 0 ... 0 
0 0 0'0 A, 0 
/o 0 0:0 0 A, 
where 
= ( ne ) (4-290) 
—Q; OC; 
If the jth complex eigenvalue pair is of multiplicity m, then A, is written 
T, I oo... 0 
0 YT, I 0 
A,;=/|9 0 T, ... 0 (m X m blocks) (4-291) 
0 0 0 T, 
where 
re) 7 si (4-292) 
L—@; G; 
I= i al (4-293 
{0 1 ) 


The modal-form matrix in Eq. (4-289) is easily modified for real and multiple- 
order eigenvalues by use of the Jordan canonical form. 

Although the modal-form matrix is not diagonal and does not represent 
decoupling of the states from the standpoint of the state diagram, it still has 
the components of the eigenvalues as its matrix elements. 

To determine the transformation matrix P for the matrix A of Eq. (4-288), 
we let 

P=([p, PJ (4-294) 
where p, and p, are 2 x | vectors. Equation (4-287) is written 
o @ 


[P, P| = Alp, P2] (4-295) 
—~—-@O da] 
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or 
op; — wp, = Ap, (4-296) 
op, + op, = Ap, (4-297) 


These two equations are expressed in matrix equation form, 


I —ol A 0 
[x atlnl“Lo ale (250 
ol ol || pz 0 Allp, 
where I denotes a 2 x 2 identity matrix. 
Let q, and q, denote the eigenvectors that are associated with the two 


complex-conjugate eigenvalues, 1, =o + jm and 1, = o — ja, respectively. 
Then, according to the definition of eigenvectors, q, and q, must satisfy 


(o + jo)q,; = Aq, (4-299) 
(o — jo)q, = Aq, (4-300) 
Let 

Gg, = %, + JB, (4-301) 
q, = &, + jp, (4-302) 

Then Eqs. (4-299) and (4-300) become 
(o + jaa, + jB,) = A(@, + jB,) (4-303) 
(a ~— ja)(%, + jB.) = A(w, + JB.) (4-304) 


Equating the real and imaginary parts in the last two equations, we have 
1 —ol][ a A Oa 
[ar or lolmLo ale. on 
ol ol JLB, 0 A/llB, 
I 1 7 A O][fa 
[wor etlel-Lo alee] (306 
—ol ol |B, 0 AJB, 


Comparing Eq. (4-305) with Eq. (4-298), we have the identity 
P=([p, Pol=[o, B,) (4-307) 
The significance of this result is that the transformation matrix P is formed 


by taking the real and imaginary components of the eigenvector of A associated 
with 4; = 0 + jo. 


EXAMPLE 4-20 Consider the state equation 


x = Ax +Br (4-308) 
where 
ee eat 
—2 — 1 
The eigenvalues of A are A, = —1 + jand A, = —1 — j. The eigenvectors are 
“ler! Sha oa 
qi Sarees q2 a5 
or 


ers the[ Jul] exesm-[]e2] 
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Therefore, 
1 0 
P=[e BI=|_. | (4-309) 
A = PAP = is | (4-310) 
J 0 
T=P(B= 5 (4-311) 
The original state equation of Eq. (4-308) is transformed to 
y=Ay+TIr (4-312) 
Then the state transition matrix is given by 
bij estes | side sin i (4-313) 
—sint cost 


4.15 Controllability of Linear Systems 


The concepts of controllability and observability introduced first by Kalman? 
play an important role in both theoretical and practical aspects of modern 
control theory. The conditions on controllability and observability often govern 
the existence of a solution to an optimal control problem, particularly in mul- 
tivariable systems. However, one should not associate these conditions with 
the concept of stability. Furthermore, not all optimal control problems require 
that the system be controllable and/or observable in order to achieve the con- 
trol objectives. These points will be clarified as the subjects are developed. In 
this section we shall first treat the subject of controllability. 


General Concept of Controllability 


The concept of controllability can be stated with reference to the block 
diagram of Fig. 4-24. The process G is said to be completely controllable if 


Control u(t) State x(t) 


Fig. 4-24. Linear time-invariant system. 


every state variable of G can be affected or controlled to reach a certain objec- 
tive in finite time by some unconstrained control u(z). Intuitively, it is simple 
to understand that if any one of the state variables is independent of the control 
u(t), there would be no way of driving this particular state variable to a desired 
state in finite time by means of a control effort. Therefore, this particular state 
is said to be uncontrollable, and as long as there is at least one uncontrollable 
state, the system is said to be not completely controllable, or simply uncon- 
trollable. 
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u(t) 


Fig. 4-25. State diagram of a system that is not state controllable. 


As a simple example of an uncontrollable system, Fig. 4-25 illustrates the 
state diagram of a linear system with two state variables. Since the control 
u(t) affects only the state x,(¢), x,(¢) is uncontrollable. In other words, it would 
be impossible to drive x,(r) from an initial state x,(t)) to a desired state X2(tp) 
in a finite time interval t, — r, by any control u(t). Therefore, the entire system 
is said to be uncontrollable. 

The concept of controllability given above refers to the states and is some- 
times referred to as the state controllability. Controllability can also be defined 
for the outputs of a system, so there is a difference between state controllability 
and output controllability. 


Definition of Controllability (State Controllability) 


Consider that a linear time-invariant system is described by the following 
dynamic equations: 
x(t) = Ax(t) + Bu(r) (4-314) 


e(t) = Dx(t) + Eu(s) (4-315) 
where 
x(t) =n X | state vector 


u(t) = r X 1 input vector 

c(t) = p X 1 output vector 
A =n X n coefficient matrix 
B=n X r coefficient matrix 
D = p X n coefficient matrix 
E = p X r coefficient matrix 


The state x(t) is said to be controllable at t = t, if there exists a piecewise 
continuous input u(t) that will drive the state to any final state x(t,) for a finite 
time (tr — ty) > 0. If every state x(t,) of the system is controllable in a finite time 
interval, the system is said to be completely state controllable or simply state 
controllable, 
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The following theorem shows that the condition of controllability depends 
on the coefficient matrices A and B of the system. The theorem also gives one 
way of testing state controllability. 


Theorem 4-2. For the system described by the state equation of Eq. (4-314) 
to be completely state controllable, it is necessary and sufficient that the following 
n X nr matrix has a rank of n: 


S=[B AB A2B...A*™'B] (4-316) 


Since the matrices A and B are involved, sometimes we say that the pair 
[A, B] is controllable, which implies that 8 is of rank n. 


Proof: The solution of Eq. (4-314) is 


x(t) = O(t — t9)Xx(to) + if b(t — 1)Bu(t) dr (4-317) 


for t > ft). Without losing any generality we can assume that the desired final 
state for some finite ty > ¢) is x(t-) = 0. Then Eq. (4-317) gives 


x(t) = — {bo — DBu(t) dr (4-318) 
to 
From the Caley—Hamilton’s theorem,?! 
A® = "31 tigpA"™ for any k (4-319) 
m=0 
Then the state transition matrix can be written 
oo kyk 
O() =e = pt 
ko k! 
Sipe diate (4-320) 
= 3 Om” 
k=0 « m=0 
or 
n= oo k 
$00) = SA" S thm y (4-321) 
m=0 k=0 k 
Thus $(¢) can be written in the form 
n=l 
b(t) = 3b) a,,()A” (4-322) 
m=0 
Substituting Eq. (4-322) into Eq. (4-318) and rearranging, we have 
x(t) = — 3 A"B J" onto — 2)u(c) de (4-323) 
m=0 to 
Let 
U, = i " (ty — t)u(t) dt (4-324) 
Then Eq. (4-323) becomes ‘ 
n-i 
x(t.) = — > A”BU,, (4-325) 
m=0 


which is written in matrix form: 
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x(t.) = —[B AB A2B...A-'BJU (4-326) 
= —SU 
where 
U=[U, U,...U,,) (4-327) 


Equation (4-325) represents » equations with mr unknowns, and the con- 
trollability problem may be interpreted as: Given any initial state x(¢,), find 
the control vector u(¢) so that the final state is x(t,) = 0 for finite t, — t). This 
implies that given x(t.) and the matrix S, solve U from Eq. (4-326). Therefore, 
the system is completely state controllable if and only if there exists a set of 
linearly independent column vectors in S. For a system with a scalar input, 
r = 1, the matrix S is square; then the condition of state controllability is that 
S must be nonsingular. 

Although the criterion of state controllability given by Theorem 4-2 is 
quite straightforward, it is not very easy to implement for multiple-input sys- 
tems. Even with r = 2, there are 2” columns in S, and there would be a large 
number of possible combinations of n x n matrices. A practical way may be 
to use one column of B at a time, each time giving ann x n matrix for S. How- 
ever, failure to find an S with a rank for n this way does not mean that the sys- 
tem is uncontrollable, until all the columns of B are used. An easier way would 
be to form the matrix SS’, which is n x n; then if SS’ is nonsingular, S has 
rank n. 


EXAMPLE 4-21 Consider the system shown in Fig. 4-25, which was reasoned earlier to 
be uncontrollable. Let us investigate the same problem using the 
condition of Eq. (4-316). 
The state equations of the system are written, from Fig. 4-25, 


oa) —2 1 i) x1) 1 
dxo(t) = Hae + A u(t) (4-328) 
dt 
Therefore, from Eq. (4-316), 
S =[B AB] =| | =A (4-329) 


which is singular, and the system is not state controllable. 


EXAMPLE 4-22 Determine the state controllability of the system described by the 
state equation 


EX) 0 Ii} xa 0 
beasts — + u(t) (4-330) 
S19} | —-1 ol]xaw| |i 
From Eq. (4-316), 
S=[B AB] = b 4 (4-331) 


which is nonsingular. Therefore, the system is completely state controllable. 
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Alternative Definition of Controllability 
Consider that a linear time invariant system is described by the state equation 
x(t) = Ax(t) + Bu(r) (4-332) 


If the eigenvalues of A are distinct and are denoted by /,,/ = 1, 2,...,n, 
then there exists an nth-order nonsingular matrix P which transforms A into a 
diagonal matrix A such that 


a4, 0 0 ... OF 
0. Ae SO are: 0 
0 O a; ... 0 
A=P"'AP=/| ; (4-333) 
|0 0 O an 
Let the new state variable be 
y = P"'x (4-334) 
Then the state equation transformed through P is 
y=Ay+Tu (4-335) 
where 
r=P''B (4-336) 


The motivation for the use of the similarity transformation is that the 
states of the system of Eq. (4-335) are decoupled from each other, and the only 
way the states are controllable is through the inputs directly. Thus, for state 
controllability, each state should be controlled by at least one input. Therefore, 
an alternative definition of state controllability for a system with distinct 
eigenvalues is: The system is completely state controllable if Y has no rows that 
are all zeros. 

It should be noted that the prerequisite on distinct eigenvalues precedes 
the condition of diagonalization of A. In other words, all square matrices with 
distinct eigenvalues can be diagonalized. However, certain matrices with 
multiple-order eigenvalues can also be diagonalized. The natural question is: 
Does the alternative definition apply to a system with multiple-order eigenvalues 
but whose A matrix can be diagonalized? The answer is no. We must not lose 
sight of the original definition on state controllability that any state x(t,) is 
brought to any state x(¢,) in finite time. Thus the question of independent con- 
trol must enter the picture. In other words, consider that we have two states 
which are uncoupled and are related by the following state equations: 


dx (t) 
dt 


eA = ax,(t) + b,u(t) (4-338) 


= ax,(t) + b,u(t) (4-337) 
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This system is apparently uncontrollable, since 


S=[B AB] = Be an | (4-339) 
b, ab, 

is singular. Therefore, just because A is diagonal, and B has no rows which 

are zeros does not mean that the system is controllable. The reason in this case 

is that A has multiple-order eigenvalues. 

When A has multiple-order eigenvalues and cannot be diagonalized, there 
is a nonsingular matrix P which transforms A into a Jordan canonical form 
A = P-:AP. The condition of state controllability is that all the elements of 
Y = PB that correspond to the last row of each Jordan block are nonzero. 
The reason behind this is that the last row of each Jordan block corresponds 
to a state equation that is completely uncoupled from the other state equations. 

The elements in the other rows of I’ need not all be nonzero, since the cor- 
responding states are all coupled. For instance, if the matrix A has four eigen- 
values, A,,4;, 41, 42, three of which are equal, then there is a nonsingular P 
which transforms A into the Jordan canonical form: 


A, 1 0) 0 
0 1:0 
eapaape |S ae 2 (4-340) 
O° 0: 2,40 
0 0 0'4”; 


Then the condition given above becomes self-explanatory. 


EXAMPLE 4-23 Consider the system of Example 4-21. The A and B matrices are, 
respectively, 


Al paul Blo) 

0 —-!1 0 
Let us check the controllability of the system by checking the rows of the matrix I. 
It can be shown that A is diagonalized by the matrix 


“El 
rere il-G]  # 


The transformed state equation is 
—2 0 1 
y(t) = t t 4- 
90= [75 {peo + [5 jo (4-342) 


Since the second row of I is zero, the state variable y(t), or x2(t), is uncontrollable, 
and the system is uncontrollable. 


Therefore, 


EXAMPLE 4-24 Consider that a third-order system has the coefficient matrices 
1 2 -—1 0 
A= |0 1 0 B= |0 
1 —4 3 1 
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Then 
0-1 —4] 
S=[B AB AB] =|0 0 0 (4-343) 
1 3 8) 


Since S is singular, the system is not state controllable. 
Using the alternative method, the eigenvalues of A are found to be J, = 2, 
Az = 2, and 43 = 1. The Jordan canonical form of A is obtained with 


1 0 0 
P= 00 1 (4-344) 
—-1 1 2 
Then 
210 
A=P-!AP=/0 2 0 (4-345) 
00 1 
0 
T =P-'!B=| ~1 (4-346) 
0 


Since the last row of I’ is zero, the state variable y3 is uncontrollable. Since x, = y3, 
this corresponds to x, being uncontrollable. 


EXAMPLE 4-25 Determine the controllability of the system described by the state 


equation 
wv _f 0 1 0 
x)= ie 0 |X + co (4-347) 
We form the matrix 
S=[B AB] = i | (4-348) 


which is nonsingular. The system is completely controllable. 
Let us now check the controllability of the system from the rows of TI. The 
eigenvalues of A are complex and are A; = j and A, = —j. With the similarity trans- 


formation, 
p=[) 7 
J oT 
A = P"1AP = le | 
0 -j 
and 
1 
T=P"B= 
2h 


Since all the rows of I’ are nonzero, the system is controllable. 
In general, when the eigenvalues are complex, which occurs quite frequently in 
control systems, it is more difficult to work with complex numbers. However, we may 
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use the modal form so that only real matrices are dealt with. In the present problem 
A may be transformed to the modal form 


AS & | = ee 5 (4-349) 
fl 


1 
T=P'B= Hl 
2. 


Since the modal form A implies that the states are coupled, the condition of control- 
lability is that not al/ the rows of I are zeros. 


by the transform matrix 


Then 


Output Controllability2® 


The condition of controllability defined in the preceding sections is referred 
only to the states of a system. Essentially, a system is controllable if every 
desired transition of the states can be effected in finite time by an unconstrained 
control. However, controllability defined in terms of the states is neither neces- 
sary nor sufficient for the existence of a solution of the problem of controlling 
the outputs of the system. 


Definition of output controllability. A system is said to be completely 
output controllable if there exists a piecewise continuous function u(t) that will 
drive the output y(¢,) at t = f, to any final output y(r,) for a finite time (t, — t,) 
> 0. 


Theorem 4-3. Consider that an nth-order linear time-invariant system is 
described by the dynamic equations of Eqs. (4-314) and (4-315). The system is 
completely output controllable if and only if the p x (n + Dr matrix 


T=[DB DAB DA’B...DA"B E] (4-350) 


is of rank p. Or, T has a set of p linearly independent columns. 
The proof of this theorem is similar to that of Theorem 4-2. 


EXAMPLE 4-26 Consider a linear system whose input-output relationship is described 
by the differential equation 

dc(t) dc(t) _ dut) 

He + 2SP + eft) = SP + w(t) (4-351) 
The state controllability and the output controllability of the system will be investi- 
gated. We shall show that the state controllability of the system depends upon how the 
state variables are defined. 

Let the state variables be defined as 


xX, =C 


X,=C—u 
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The state equations of the system are expressed in matrix form as 
X11 0 ql E i | | 
— + u 4-352 
EF | | —1 —2 x2 —] ¢ ) 


62% (4-353) 


The output equation is 


The state controllability matrix is 


S=(B aBl=| | zs] (4-354) 
which is singular. The system is not state controllable. 
From the output equation, D=[1 0] and E = 0. The output controllability 
matrix is written 
T=([DB DAB E]J=[!i —1 0] (4-355) 


which is of rank 1, the same as the number of output. Thus the system is output con- 
trollable. 

Now let us define the state variables of the system in a different way. By the 
method of direct decomposition, the state equations are written in matrix form: 


| : & 4 2 * H ; (4-356) 


The output equation is 


C= xX, + x2 (4-357) 
The system is now completely state controllable since 
S=[B AB] = ki | (4-358) 


which is nonsingular. 
The system is still output controllable since 
T=[DB DAB E]={[1 —1 0] (4-359) 
which is of rank 1. 

We have demonstrated through this example that given a linear system, state 
controllability depends on how the state variables are defined. Of course, the output 
controllability is directly dependent upon the assignment of the output variable. The 
two types of controllability are not at all related to each other. 


4.16 Observability of Linear Systems 


The concept of observability is quite similar to that of controllability. Essen- 
tially, a system is completely observable if every state variable of the system 
affects some of the outputs. In other words, it is often desirable to obtain in- 
formation on the state variables from measurements of the outputs and the 
inputs. If any one of the states cannot be observed from the measurements of 
the outputs, the state is said to be unobservable, and the system is not complete- 
ly observable, or is simply unobservable. Figure 4-26 shows the state diagram of 
a linear system in which the state x, is not connected to the output c in any way. 
Once we have measured c, we can observe the state x,, since x, = c. However, 
the state x, cannot be observed from the information on c. Thus the system is 
described as not completely observable, or simply unobservable. 
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u(t) 


Fig. 4-26. State diagram of a system that is not observable. 


Definition of observability. Given a linear time-invariant system that is 
described by the dynamic equations of Eqs. (4-314) and (4-315), the state x(to) 
is said to be observable if given any input u(t), there exists a finite time t, > to 
such that the knowledge of w(t) for ty <t <t,; the matrices A, B, D, and E; and 
the output c(t) for tp <t < t, are sufficient to determine x(t,). If every state of 
the system is observable for a finite t,, we say that the system is completely ob- 
servable, or simply observable. 

The following theorem shows that the condition of observability depends 
on the coefficient matrices A and D of the system. The theorem also gives one 
method of testing observability. 


Theorem 4-4. For the system described by the dynamic equation of Eqs. 
(4-314) and (4-315) to be completely observable, it is necessary and sufficient 
that the following n x np matrix has a rank of n: 


V=[D’ A'D’ (A’2D’... (A) D] (4-360) 


The condition is also referred to as the pair [A, D] being observable. In 
particular, if the system has only one output, D is an I x n matrix; V of Eq. 
(4-360) is ann xX n square matrix. Then the system is completely observable if V 
is nonsingular. 


Proof: Substituting Eq. (4-317) into Eq. (4-315), we have 
c(t) = Dob(t — to)x(t.) + D i‘ O(t — 1)Bu(t) de + Eu(t) (4-361) 


Based on the definition of observability, it is apparent that the observability 
of x(t.) depends essentially on the first term of the right side of Eq. (4-361). 
With u(z) = 0, Eq. (4-361) becomes 


e(t) = DO(t — to)x(to) (4-362) 
Making use of Eq. (4-322), Eq. (4-362) becomes 


w= >» 0,,(t)DA™X(t9) (4-363) 
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or 
DA 


DA? 
c(t) = (ool... aD) |X(to) (4-364) 


| DA”- ; _! 


Therefore, knowing the output e(¢) over the time interval ¢, <t < ty, x(t) 
is uniquely determined from Eq. (4-364) if and only if the matrix 


D 
DA 
DA? 
(np X n) 
| DA"! | 
has rank n. Or the matrix 
V=([D’ AD’ (A’?D...(A’)"'D] (4-365) 


has a rank of n. 
Comparing Eq. (4-360) with Eq. (4-316) and the rank condition, the 
following observations may be made: 


1. Controllability of the pair [A,B] implies observability of the pair 
[A’, B’]. 

2. Observability of the pair [A, B] implies controllability of the pair 
[A’, B’]. 


EXAMPLE 4-27 Consider the system shown in Fig. 4-26, which was earlier defined to 
be unobservable. The dynamic equations of the system are written 
directly from the state diagram. 


[3 7 lo Ey bal * le (4-366) 


ei ai] | (4-367) 
x2 
Therefore, 
Ret 
D=[i 0] D’ = A 
leer ie 
0 —1jL0 0 
and, from Eq. (4-360), 
peo peeeen ek’ 2 : 
V=[pD ApI=| a (4-368) 


Since V is singular, the system is unobservable. 
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EXAMPLE 4-28 Consider the linear system described by the following dynamic 
equations: 


a 7 F ae | + i ale (4-369) 
Bl z ea | (4-370) 


For the test of observability, we evaluate 


cf ELE am 


The observability matrix becomes 


1 —-1 1 0 
V=([D’ A’D)= 4-372 
l EF ee 3] (4-372) 
Since V has a rank of 2, which is the number of inputs, the system is completely 
observable. 


EXAMPLE 4-29 Let us consider the system described by the differential equation of 
Eq. (4-351), Example 4-26. In Example 4-26 we have shown that 
state controllability of a system depends on how the state variables 

are defined. We shall now show that the observability also depends on the definition 

of the state variables. Let the dynamic equations of the system be defined as in Eqs. 


(4-352) and (4-353), 
A= | : | D=[l1 0] 
—1 -2 
Then 
, FA i 1 0 
V=[)D’ AD]= F | (4-373) 

and thus the system is completely observable. 

Let the dynamic equations of the system be given by Eqs. (4-356) and (4-357). 


Then 
A=| 5 D=[l 1 


Then 

Te, eras 1 -1 

V=(D' AD) = [ | 
1 —1 

which is singular. Thus the system is unobservable, and we have shown that given the 
input-output relation of a linear system, the observability of the system depends on 
how the state variables are defined. It should be noted that for the system of Eq. 
(4-351), one method of state variable assignment, Eqs. (4-352) and (4-353) yields a 
system that is observable but not state controllable. On the other hand, if the dynamic 
equations of Eqs. (4-356) and (4-357) are used, the system is completely state control- 
lable but not observable. There are definite reasons behind these results, and we shall 
investigate these phenomena further in the following discussions. 


Alternative definition of observability. If the matrix A has distinct eigen- 
values, it can be diagonalized as in Eq. (4-333). The new state variable is 


y= Px (4-374) 
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The new dynamic equations are 


y=Ay+Tu (4-375) 
c= Fy + Eu (4-376) 

where 
F = DP (4-377) 


Then the system is completely observable if F has no zero columns. 

The reason behind the above condition is that if the jth (j = 1, 2,...,7) 
column of F contains all zeros, the state variable y, will not appear in Eq. 
(4-376) and is not related to the output ¢(t). Therefore, y, will be unobservable. 
In general, the states that correspond to zero columns of F are said to be un- 
observable, and the rest of the state variables are observable. 


EXAMPLE 4-30 Consider the system of Example 4-27, which was found to be un- 
observable. Since the A matrix, as shown in Eq. (4-366), is already a 
diagonal matrix, the alternative condition of observability stated 

above requires that the matrix D = [1 0] must not contain any zero columns. Since 

the second column of D is indeed zero, the state x, is unobservable, and the system 
is unobservable. 


4.17 Relationship Among Controllability, Observability, 
and Transfer Functions 


In the classical analysis of control systems, transfer functions are often used 
for the modeling of linear time-invariant systems. Although controllability 
and observability are concepts of modern control theory, they are closely 
related to the properties of the transfer function. 

Let us focus our attention on the system considered in Examples 4-26 and 
4-29. It was demonstrated in these two examples that the system is either not 
state controllable or not observable, depending on the ways the state variables 
are defined. These phenomena can be explained by referring to the transfer 
function of the system, which is obtained from Eq. (4-351). We have 


Cs) s+) std 1 ; 
Us) s?-2s+l G+! stl (4-378) 
which has an identical pole and zero at s = —1. The following theorem gives 


the relationship between controllability and observability and the pole-zero 
cancellation of a transfer function. 


Theorem 4-5. If the input-output transfer function of a linear system has 
pole-zero cancellation, the system will be either not state controllable or un- 
observable, depending on how the state variables are defined. If the input-output 
transfer function of a linear system does not have pole-zero cancellation, the 
system can always be represented by dynamic equations as a completely con- 
trollable and observable system. 


Proof: Consider that an nth-order system with a single input and single 
output and distinct eigenvalues is represented by the dynamic equations 

x(t.) = Ax(t) + Bus) (4-379) 

c(t) = Dx(2) (4-380) 
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Let. the A matrix be diagonalized by an n x n Vandermonde matrix P, 


1 I 1 1 
Ay Ag Age shes, CAR 
P=| 2% z a ee, AAR (4-381) 
a ee 
The new state equation in canonical form is 
y(t) = Ay(t) + Fu(e) (4-382) 
where A = P“!AP. The output equation is transformed into 
c(t) = Fy(t) (4-383) 
where F = DP. The state vectors x(t) and y(t) are related by 
x(t) = Py(r) (4-384) 
Since A is a diagonal matrix, the ith equation of Eq. (4-382) is 
At) = AyD) + pad) (4-385) 


where A, is the ith eigenvalue of A and y, is the ith element of I, where I is an 
n X | matrix in the present case. Taking the Laplace transform on both sides 
of Eq. (4-385) and assuming zero initial conditions, we obtain the transfer 
function relation between Y,(s) and U(s) as 


eee fi “i 
Y(s) = ew I U(s) (4-386) 
The Laplace transform of Eq. (4-383) is 
C(s) = FY(s) = DPY(s) (4-387) 
Now if it is assumed that 
D=[d, d, ... d,J (4-388) 
then 
F=DP+[/, f ... fil (4-389) 
where 
fr=d,+da,4;+ ... +4,d4m! (4-390) 


for i= 1,2,..., mn. Equation (4-387) is written as 
Gs)=th fr --. Fil¥(s) 
ys 
s—A, 
Y2 


= fi -. A 7 low (4-391) 
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For the nth-order system with distinct eigenvalues, let us assume that the 
input-output transfer function is of the form 


C(s) __ K(s — a,(s — ay)... (S — an) f 


Us) (s—A,(s—”,)... 5 —A,) nAl>m (4-392) 
which is expanded by partial fraction into 
Cs) _y CG; : 
Us) fis—d, (4-393) 


where o; denotes the residue of C(s)/U(s) at s = A,. 

It was established earlier that for the system described by Eq. (4-382) to 
be state controllable, all the rows of I must be nonzero; that is, y, 40 for 
i=1,2,...,n. If C(s)/U(s) has one or more pairs of identical pole and zero, 
for instance in Eq. (4-392), a, = 4,, then in Eq. (4-393), a, = 0. Comparing 
Eq. (4-391) with Eq. (4-393), we see that in general 


Oo, = fil: (4-394) 
Therefore, when a, = 0, y, will be zero if f, 4 0, and the state y, is uncontrol- 
lable. 

For observability, it was established earlier that F must not have columns 
containing zeros. Or, in the present case, f,; 4 0 for i = 1, 2,...,m. However, 
from Eq. (4-394), 

f=% (4-395) 
y: 


When the transfer function has an identical pair of pole and zero at a, = 4, 
o; == 0. Thus, from Eq. (4-395), f; = 0 if y, 4 0. 


4.18 Nonlinear State Equations and Their Linearization 


When a dynamic system has nonlinear characteristics, the state equations of 
the system can be represented by the following vector-matrix form: 

HD — s1x(1), r(0)] (4-396) 
where x(t) represents the » x 1 state vector, r(t) the p x | input vector, and 
f[x(), r()] denotes an m x 1 function vector. In general, f is a function of the 
state vector and the input vector. 

Being able to represent a nonlinear and/or time-varying system by state 
equations is a distinct advantage of the state-variable approach over the transfer 
function method, since the latter is defined strictly only for linear time-invariant 
systems. 

As a simple illustrative example, the following state equations are non- 
linear: 

PHO — x) + 0 
(4-397) 


P29 — x.) + 10 
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Since nonlinear systems are usually difficult to analyze and design, it would 
be desirable to perform a linearization whenever the situation justifies. 

A linearization process that depends on expanding the nonlinear state 
equation into a Taylor series about a nominal operating point or trajectory 
is now described. All the terms of the Taylor series of order higher than 1 are 
discarded, and linear approximation of the nonlinear state equation at the 
nominal point results. 

Let the nominal operating trajectory be denoted by x,(t), which corresponds 
to the nominal input r,(r) and some fixed initial states. Expanding the nonlinear 
state equation of Eq. (4-396) into a Taylor series about x(t) = x,(t) and neglect- 
ing all the higher-order terms yields 


X(t) = f(Xo.¥o) + >> fix 0) (x; — Xo,) 
‘ ara. . ar (4-398) 
+ >> or, basal = roj) 
i= 1,2,...,n. Let 
Ax; = X; — Xo; (4-399) 
and 
Ar; =r; — ro; (4-400) 
Then 
Ax; = X%; — Xo: (4-401) 
Since 
Xo: = fi(Xo, Vo) (4-402) 
Equation (4-398) is written 
Ax = SURED) ax, + SOW) vr, (4-403) 
FA OX; kare Fir; Naar 


The last equation may be written in the vector-matrix form 


Ax = A*Ax + B*Ar (4-404) 
where 7 

of, Of ofr | 
Ox; Ox, “" OX, 
of, Of, of, 

At —| 0x, Ox, Ox, (4-405) 
of, of, of, 
Ox, Ox, Ox, 
of, of; Of | 
Or, Or, or, 

Bt —| Or, Or, or, (4-406) 
Of, Of of, 
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where it should be reiterated that A* and B* are evaluated at the nominal point. 
Thus we have linearized the nonlinear system of Eq. (4-396) at a nominal 
operating point. However, in general, although Eq. (4-404) is linear, the ele- 
ments of A* and B* may be time varying. 

The following examples serve to illustrate the linearization procedure just 
described. 


EXAMPLE 4-31 Figure 4-27 shows the block diagram of a control system with a 
saturation nonlinearity. The state equations of the system are 


xX =f, = X2 (4-407) 
X2 =f, =u (4-408) 


3 xy 
xX =Ax + Bu 


Fig. 4-27. Nonlinear control system. 


where the input-output relation of the saturation nonlinearity is represented by 


u = (1 — e-*!*1!) SGN x, (4-409) 
where 
+1 x,>0 
SGN x1 = (4-410) 
—1 xi< 0 


Substituting Eq. (4-409) into Eq. (4-408) and using Eq. (4-403), we have the 
linearized state equation 


Ax, — gh Ax, = Ax, (4-411) 
Ax, = Sh Ax, = Ke-KixlAx, (4-412) 


where x; denotes a nominal value of x,;. Notice that the last two equations are linear 
and are valid only for small signals. In vector-matrix form, these linearized state 


equations are written as 
Ax 1 0 1 Ax 1 
= 4-413 
ee b ‘| re cr 


a = Ke-*!*0! = constant (4-414) 


It is of interest to check the significance of the linearization. If xg, is chosen to 
be at the origin of the nonlinearity, x9; = 0, then a = K; Eq. (4-412) becomes 


Ax, = K Ax, (4-415) 


Thus the linearized model is equivalent to having a linear amplifier with a constant 


where 
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gain K. On the other hand, if xo, is a large number, the nominal operating point will 
lie on the saturated portion of the nonlinearity, and a = 0. This means that any small 
variation in x, (small Ax,) will give rise to practically no change in Ax}. 


EXAMPLE 4-32 In the last example the linearized system turns out to be time invari- 
ant. In general, linearization of a nonlinear system often leads to a 
linear time-varying system. Consider the following nonlinear system: 

; —1 
x, = xP (4-416) 
X_. = ux, (4-417) 


We would like to linearize these equations about the nominal trajectory [xo1(f), 
Xo2(t)], which is the solution of the equations with the initial conditions x,(0) = x,(0) 
= 1| and the input u(t) = 0. 

Integrating both sides of Eq. (4-417), we have 

Xz = x,(0) = 1 (4-418) 
Then Eq. (4-416) gives 

x,=—-t+1 (4-419) 
Therefore, the nominal trajectory about which Eqs. (4-416) and (4-417) are to be 
linearized is described by 


Xoi(t) = —t+1 (4-420) 
Xor(t) = 1 (4-421) 
Now evaluating the coefficients of Eq. (4-403), we get 
Equation (4-403) gives 
Ax, = san (4-422) 
Ax2 = upAx; + x9,Au (4-423) 


Substituting Eqs. (4-420) and (4-421) into Eqs. (4-422) and (4-423), the linearized 
equations are written as 


Ax, = 0 2 Ax, 0 
peal 7 lo al Fe F = Ae vey 


which is a set of linear state equations with time-varying coefficients. 


4.19 State Equations of Linear Discrete-Data Systems 


Similar to the continuous-data systems case, a modern way of modeling a 
discrete-data system is by means of discrete state equations. As described earlier, 
when dealing with discrete-data systems, we often encounter two different 
situations. The first one is that the components of the system are continuous- 
data elements, but the signals at certain points of the system are discrete or 
discontinuous with respect to time, because of the sample-and-hold operations. 
In this case the components of the system are still described by differential 
equations, but because of the discrete data, a set of difference equations may be 


162 / State-Variable Characterization of Dynamic Systems Chap. 4 


generated from the original differential equations. The second situation involves 
systems that are completely discrete with respect to time in the sense that they 
receive and send out discrete data only, such as in the case of a digital controller 
or digital computer. Under this condition, the system dynamics should be 
described by difference equations. 

Let us consider the open-loop discrete-data control system with a sample- 
and-hold device, as shown in Fig. 4-28. Typical signals that appear at various 
points in the system are also shown in the figure. The output signal, c(¢), 


r(t) r*(t) Zero-order h(t) c(t) 
mas sees 


T 


r(t) 


r*(t) 


T 2T 37 47 ST 6T 77 


A(t) 


T 2T 37 47 ST 6T 7T 


c(t) 


Fig. 4-28. Discrete-data system with sample-and-hold. 
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ordinarily is a continuous-data signal. The output of the sample-and-hold, A(t), 
is a train of steps. Therefore, we can write 


WkT) =r(kT) k=0,1,2,... (4-425) 


Now we let the linear process G be described by the state equation and out- 
put equation: 


a = Ax(t) + BA(t) (4-426) 


c(t) = Dx(t) + EA(s) (4-427) 
where x(t) is the state vector and A(t) and c(t) are the scalar input and output 
signals, respectively. The matrices A, B, D, and E are coefficient matrices which 
have been defined earlier. Using Eq. (4-70), the state transition equation of the 
system is written 


x(t) = O(t — to)X(to) + i $(¢ — t)BA(z) dz (4-428) 
for t > ty. ss 
If we are interested only in the responses at the sampling instants, just as 
in the case of the z-transform solution, we let t = (k + 1)T and ty = kT. Then 
Eq. (4-428) becomes 


x[(k + DT] = O(T)x(kT) + ies Ok + 1)T — t]Bh(t) dr (4-429) 


where @(¢) is the state transition matrix as defined in Section 4.4. 

Since A(t) is piecewise constant, that is, A(kT)=r(kT) for kT<t< 
(k + 1)T, the input function A(t) in Eq. (4-429) can be taken outside the integral 
sign. Equation (4-429) is written 


(k+1)T 
x[(kK + 1)T] = (7)x(KT) + le o[(k + 1)T —t]Bdtr(kT) (4-430) 
or 
x{(K + IT] = G(T )x(kT) 4- (T)r(kT) (4-431) 
where 
(k+1)T 
@(T) = j Ok + DT — Bar (4-432) 
T 
Equation (4-431) is of the form of a linear difference equation in vector-matrix 
form. Since it represents a set of first-order difference equations, it is referred 
to as the vector-matrix discrete state equation. 
The discrete state equation in Eq. (4-431) can be solved by means of a 
simple recursion procedure. Setting k = 0, 1, 2,... in Eq. (4-431), we find that 
the following equations result: 


k=0: x(T) = $(T)x(0) + @(T)r(0) (4-433) 
k=1: x(2T) = $(T)x(T) + AT )(T) (4-434) 


k=2: x(3T) = 6(T)x(2T) + O(T)r(2T) (4-435) 


k=k—1:  x(kT) = $(T)x[(k — DT) + OT i(k — DT] (4-436) 
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Substituting Eq. (4-433) into Eq. (4-434), and then Eq. (4-434) into Eq. (4-435), 
..., and so on, we obtain the following solution for Eq. (4-431): 


x(KT) = OM T)K(0) +S GM TIOT GT) (4-437) 


Equation (4-437) is defined as the discrete state transition equation of the discrete- 
data system. It is interesting to note that Eq. (4-437) is analogous to its continu- 
ous counterpart in Eq. (4-67). In fact, the state transition equation of Eq. 
(4-67) describes the state of the system of Fig. 4-28 with or without sampling. 
The discrete state transition equation of Eq. (4-437) is more restricted in that it 
describes the state only at t = kT (k = 0, 1, 2,...), and only if the system has 
a sample-and-hold device such as in Fig. 4-28. 

With kT considered as the initial time, a discrete state transition equation 
similar to that of Eq. (4-70) can be obtained as 


x[(k + N)T] = 6'(T)x(KT) + > OY (T)/O(T)r[(k + )T] (4-438) 


where N is a positive integer. The derivation of Eq. (4-438) is left as an exercise 
for the reader. 

The output of the system of Fig. 4-28 at the sampling instants is obtained by 
substituting t = kT and Eq. (4-437) into Eq. (4-427), yielding 


(kT) = Dx(kT) + Ek(KT) 
= DGH(T)x(0) + D'S, g*-1(TCTYH(ET) + BH(KT) 


An important advantage of the state-variable method over the z-transform 
method is that it can be modified easily to describe the states and the output 
between sampling instants. In Eq. (4-428) if we let ¢ = (k -- A)T, where 0 << 
A <1 and ft) = kT, we get 


(kt A)T 
x[(k + A)T] = $(AT)x(KT) + fe. o[(k + A)T — 7)B dt r(kT) 
= (AT)X(KT) + O(AT)r(KT) 
By varying the value of A between 0 and 1, the information between the sam- 


pling instants is completely described by Eq. (4-440). 
One of the interesting properties of the state transition matrix $(f) is that 


6*(T) = $(kT) (4-441) 


(4-439) 


(4-440) 


which is proved as follows. 
Using the homogeneous solution of the state equation of Eq. (4-426), 


we have 

x(t) = (t — to)x(to) (4-442) 
Let t = kT and t, = 0; the last equation becomes 

x(kKT) = 6(kT)x(0) (4-443) 


Also, by the recursive procedure with t= (kK + 1)T and t, = kT, k = 0,1, 
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2,..., Eq. (4-442) leads to 
x(kT) = $*(T)x(0) (4-444) 


Comparison of Eqs. (4-443) and (4-444) gives the identity in Eq. (4-441). 
In view of the relation of Eq. (4-441), the discrete state transition equations 
of Eqs. (4-437) and (4-438) are written 


x(KT) = $(KT)x(0) +S lk — i — NTIOCTGT) (4-445) 
xi(k + NYT] = $(NT)x(KT) + = ON —i— TIO )(K + DT] (4-446) 


respectively. These two equations can be modified to represent systems with 
multiple inputs simply by changing the input r into a vector r. 

When a linear system has only discrete data throughout the system, its 
dynamics can be described by a set of discrete state equations 


x[(K + 1)T] = Ax(KT) 4+ Br(kT) (4-447) 
and output equations 
e(kT) = Dx(kT) + Er(kT) (4-448) 


where A, B, D, and E are coefficient matrices of the appropriate dimensions. 
Notice that Eq. (4-447) is basically of the same form as Eq. (4-431). The only 
difference in the two situations is the starting point of the system representation. 
In the case of Eq. (4-431), the starting point is the continuous-data state equa- 
tions of Eq. (4-426); @(7) and @(7) are determined from the A and B matrices 
of Eq. (4-426). In the case of Eq. (4-447), the equation itself represents an out- 
right description of the discrete-data system, which has only discrete signals. 
The solution of Eq. (4-447) follows directly from that of Eq. (4-431). 
Therefore, the discrete state transition equation of Eq. (4-447) is written 


x(kT) = A*x(0) + 57 A*-1Br(iT) (4-449) 
0 
where 
A‘ = AAAA...A (4-450) 
ke 


4.20 z-Transform Solution of Discrete State Equations 


The discrete state equation in vector-matrix form, 
x[(K + 1)T] = Ax(kT) + Br(kT) (4-451) 


can be solved by means of the z-transform method. Taking the z-transform on 
both sides of Eq. (4-451) yields 


zX(z) — zx(0+) = AX(z) + BR) (4-452) 
Solving for X(z) from the last equation gives 


X(z) = (zl — A)-*zx(0+) + (zl — A) BR(z) (4-453) 
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The inverse z-transform of the last equation is 
x(AT) = g7'[(zI — A)~'z}x(0) + g-4[ (21 — A) 'BR(z)] (4-454) 


In order to carry out the inverse z-transform operation of the last equation, we 
write the z-transform of A* as 


g(A®) = SAR = 14 Az + Az (4-455) 
k=0 


Premultiplying both sides of the last equation by Az~! and subtracting the 
result from the last equation, we get 


(I — Az~')g(A*) = I (4-456) 
Therefore, solving for g(A*) from the last equation yields 
g(A*) = (I— Az7!)"! = (2 — A)-!z (4-457) 
or 
A¥ = g°'[(zI — A)-!z] (4-458) 


Equation (4-458) also represents a way of finding A* by using the z-transform 


method. Similarly, we can prove that 
5-[(l ~ A) BR@)] =F AmB) (4-459) 
i=0 


Now we substitute Eqs. (4-458) and (4-459), into Eq. (4-454) and we have the 
solution for x(kT) as 


x(kT) = A*K(0) + 5 AK 1Br(iT) (4-460) 


which is identical to the expression in Eq. (4-449). 

Once a discrete-data system is represented by the dynamic equations of 
Eqs. (4-447) and (4-448), the transfer function relation of the system can be 
expressed in terms of the coefficient matrices. 

Setting the initial state x(0+) to zero, Eq. (4-453) gives 


X(z) = (zI — A)~!BR(z) (4-461) 
When this equation is substituted into the z-transformed version of Eq. (4-448), 
we have 
C(z) = [D(@I — A)-'B + EJR(z) (4-462) 
Thus the transfer function matrix of the system is 
G(z) = D@I — A)'B+E (4-463) 


This equation can be written 


_ D [adj (zI — A)]B + |zI— AJE : 
G(z) = a (4-464) 
The characteristic equation of the system is defined as 
|zI~ A|=0 (4-465) 


In general, a linear time-invariant discrete-data system with one input and 
one output can be described by the following linear difference equation with 
constant coefficients: 
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cl(k + n)T) + a,c((A +n ~ 1)T] 4+ a.cl(k +2 —2)T] +... 
+ a,-,¢cl(k + 1)T] + a,c(kT) 
= borl(k + mT] + byr[(k + m—1)T] +... 
+ Da wl(kK + YT) + bar(kT) n>m 
Taking the z-transform on both sides of this equation and rearranging terms, 
the transfer function of the system is written 
m mat 
Ro- aeteee SD 
The characteristic equation is defined as 


(4-466) 


z+ a+... +4,.,2 +a, =0 (4-468) 

EXAMPLE 4-33 Consider that a discrete-data system is described by the difference 
equation 

c(k + 2) + S5e(k + 1) + 3clk) = r(k + 1) + 2r(k) (4-469) 


Taking the z-transform on both sides of the last equation and assuming zero initial 
conditions yields 


27C(z) + 5zC(z) + 3C(z) = zR(z) + 2R(z) (4-470) 
From the last equation the transfer function of the system is easily written 
0G I ae a (4-471) 


Riz) 224+ 5z+3 


The characteristic equation is obtained by setting the denominator polynomial of the 
transfer function to zero, 


z4+5z+3=0 (4-472) 

The state variables of the system are arbitrarily defined as 
x(k) = c(k) (4-473) 
X2(k) = x1(k + 1) — rk) (4-474) 


Substitution of the last two relations into the original difference equation of Eq. 
(4-469) gives the two state equations of the system as 


x(k + 1) = x(k) + r(k) (4-475) 
X2(k + 1) = —3x1(k) — S5x2(k) — 3r(k) (4-476) 
from which we have the A matrix of the system, 
0 1 
= 4-477 
a=| 3 5 (4.477) 


The same characteristic equation as in Eq. (4-472) is obtained by using | zI — Aj = 0. 


4.21 State Diagrams for Discrete-Data Systems 


When a discrete-data system is described by difference equations or discrete 
state equations, a discrete state diagram may be constructed for the system. 
Similar to the relations between the analog computer diagram and the state 
diagram for a continuous-data system, the elements of a discrete state diagram 
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resemble the computing elements of a digital computer. Some of the operations 
of a digital computer are multiplication by a constant, addition of several 
machine variables, time delay, or shifting. The mathematical descriptions of 
these basic digital computations and their corresponding z-transform expres- 


sions are as follows: 


1. Multiplication by a constant: 


2. Summing: 


3. Shifting or time delay: 


or 
a 
X, (2) -——>-—_——0 YX, (z) 


X4(z) = aX, (2) 


Xo (z) 


X,@) 


x) (z) 


Xy(z) = Xo(z) + X (2) 


xy (0 +) 


] 
X,(Z) X,(z) 
Xy (2) = 2-1Xy(z) + x1 (0 +) 


Fig. 4-29. Basic elements of a discrete 
state diagram. 


x(kT) = ax (kT) (4-478) 
X,(z) = aX,(z) (4-479) 
x(kT) = xo(kT) + x(kT) (4-480) 
XZ) = X,(z) + X12) (4-481) 
x(kT) = x,[(k + 1)T) (4-482) 
X,(z) = 2X,(z) — zx,(0+) (4-483) 
X (2) = 271X,(z) + x,(0+) (4-484) 


The state diagram representations of these opera- 
tions are illustrated in Fig. 4-29, The initial time ¢ = 0+ 
in Eq. (4-484) can be generalized to 1 = t{. Then Eq. 
(4-484) is written 


X,(z) = 271 X,(z) + x, (03) (4-485) 


which represents the discrete-time state transition for 
time greater than or equal to ff. 


EXAMPLE 4-34 Consider again the difference equation in 


Eq. (4-469), which is 


ek + 2) + Se(k + 1) + 3c(k) = rk + 1) + rk) 
(4-486) 


One way of constructing the discrete state diagram for the 
system is to use the state equations. In this case the state 
equations are available in Eqs. (4-475) and (4-476) and these 
are repeated here: 


x(k + 1) = x2(k) + r(k) (4-487) 
x(k + 1) = —3x1(k) — Sx2(k) — 3rk) (4-488) 


Using essentially the same principle as for the state diagrams 
for continuous-data systems, the state diagram for Eqs. (4-487) 
and (4-488) is constructed in Fig. 4-30. The time delay unit 
z! is used to relate x;(k + 1) to x,(k). The state variables 
will always appear as outputs of the delay units on the state 
diagram. 
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Fig. 4-30. Discrete state diagram of the system described by the difference 
equation of Eq. (4-486) or by the state equations of Eqs. (4-487) and 
(4-488). 


As an alternative, the state diagram can also be drawn directly from the differ- 
ence equation by means of the decomposition schemes. The decomposition of a discrete 
transfer function will be discussed in the following section, after we have demon- 
strated some of the practical applications of the discrete state diagram. 

The state transition equation of the system can be obtained directly from the 
state diagram using the gain formula. Referring to X,(z) and X2(z) as the output nodes 
and to x,(0+-), x.(0+), and R(z) as input nodes in Fig. 4-30, the state transition 
equations are written in the following vector-matrix form: 


Xi@)] _ APh + S278 POF], 1 fel + 5274) — 3272 : 
Ba ~ x 3271 4 iT x2(0 | + x| Sap ee) i (4-489) 


where 

A =1 +527! + 3272 (4-490) 
The same transfer function between R(z) and C(z) as in Eq. (4-471) can be obtained 
directly from the state diagram by applying the gain formula between these two nodes. 


Decomposition of Discrete Transfer Functions 


The three schemes of decomposition discussed earlier for continuous-data 
systems can be applied to transfer functions of discrete-data systems without 
the need of modification. As an illustrative example, the following transfer 
function is decomposed by the three methods, and the corresponding state 
diagrams are shown in Fig. 4-31: 

C(z) =z 4+2 7 

RG) 5243 a) 
Equation (4-491) is used for direct decomposition after the numerator and the 
denominator are both multiplied by z~2. For cascade decomposition, the trans- 


(a) Direct decomposition 


1 


(c) Parallel decomposition 


Fig. 4-31. State diagrams of the transfer function C(z)/R(z) =: (z + 2)/(z2 
+ 5z + 3) by the three methods of decomposition. (a) Direct decomposi- 
tion. (b) Cascade decomposition. (c) Parallel decomposition. 
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fer function is first written in factored form as 
C(z) __ z+2 7 
R@) ~~ @ 2 4.3\G +07) C2) 
For the parallel decomposition, the transfer function is first fractioned by 
partial fraction into the following form: 


C(z)__ 0.64 0.36 


R@) 7443 17407 22) 


4.22 State Diagrams for Sampled-Data Systems 


When a discrete-data system has continuous-data as well as discrete-data 
elements, with the two types of elements separated by sample-and-hold devices, 
a special treatment of the state diagram is necessary if a description of the 
continuous-data states is desired for all times. 

Let us first establish the state diagram of the zero-order hold. Consider 
that the input of the zero-order hold is denoted by e*(¢) which is a train of 
impulses, and the output by A(t). Since the zero-order hold simply holds the 
magnitude of the input impulse at the sampling instant until the next input 
comes along, the signal A(t) is a sequence of steps. The input-output relation 
in the Laplace domain is written 


H(s) ==“) (4-494) 


In the time domain, the relation is simply 
A(t) = e(kT+) (4-495) 
for kT <t<(k+1)T. 
In the state diagram notation, we need the relation between A(s) and 
e(kT+). For this purpose we take the Laplace transform on both sides of Eq. 
(4-495) to give 


e(kAT+ 
e(kT +) : H(s) H(s) = (AF) ; ) (4-496) 


Ss 


—_—_—_——————— 0 


for AT<t<(k + 1)T. The state diagram representa- 


Fig. 4-32. State diagram rep- tion of the zero-order hold is shown in Fig. 4-32. As 
resentation of the zero-order an illustrative example on how the state diagram of a 


hold. 


sampled-data system is constructed, let us consider the 
system shown in Fig. 4-33. We shall demonstrate the 
various available ways of modeling the input-output relations of the system. 
First, the Laplace transform of the output of the system is written 


l—e™ 1 
oy 


e(t) a e*(t) Ee A(t) [ ooh | 1 c(t) 
order hold As) stl 
P 


Fig. 4-33. Sampled-data system. 


E*(s) (4-497) 
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Taking the z-transform on both sides of the last equation vields 
Co) = 1&7 E2) (4-498) 


Given information on the input e(t) or e*(t), Eq. (4-498) gives the output 
response at the sampling instants. 

A state diagram can be drawn from Eq. (4-498) using the decomposition 
technique. Figure 4-34 illustrates the discrete state diagram of the system through 


x, (0+) 


l-eT xck+)T 27! 


e(kT +) X,(z) 


~eT 


Fig. 4-34. Discrete state diagram of the system in Fig. 4-33. 


decomposition. The discrete dynamic equations of the system are written 
directly from this state diagram: 

X[(K + IT] = e 7x (KT) + Ul — eT )e(kT) (4-499) 

c(kKT) = x,(kT) (4-500) 

Therefore, the output response of the system can also be obtained by solving 
the difference equation of Eq. (4-499). 

If the response of the output c(t) is desired for all 7, we may construct the 

state diagram shown in Fig. 4-35. This state diagram is obtained by cascading 

the state diagram representations of the zero-order hold and the process G(s). 


x, (kT +) 
s 


e(kT +) H(s) 


Fig. 4-35. State diagram for the system of Fig. 4-33 for the time interval 
AT<Sr=(kK + YT. 


Sec. 4.23 State Equations of Linear Time-Varying Systems / 173 


To determine c(t), which is also x,(#), we must first obtain X,(s) by applying 
the gain formula to the state diagram of Fig. 4-35. We have 


Xs) = eek +) + i Se = x,(kT) (4-501) 
forkT<t<(k+ DT. ae the inverse Laplace transform of the last equa- 
tion gives 

x1) = [1 — eM e(KT+) + 7 ¢- Mx, (KT) (4-502) 


kT <t<(k + IVT. It is interesting to note that in Eq. (4-502) ¢ is valid for 
one sampling period, whereas the result in Eq. (4-499) gives information on 
x,(¢) only at the sampling instants. It is easy to see that if we let t = (k + 1)T 
in Eq. (4-502), the latter becomes Eq. (4-499). 


4.23 State Equations of Linear Time-Varying Systems 


When a linear system has time-varying elements, it can be represented by the 
following dynamic equations: 
so ) = A@)x(t) + BOD) (4-503) 
oA = D()x(4) + E)r(a) (4-504) 
where 
x(t) =n X | state vector 


r(t) = p X 1 input vector 
c(t) = q X | output vector 
A(t), B(t), D(t), and E(t) are coefficient matrices of appropriate dimensions. 
The elements of these coefficient matrices are functions of ¢. 
Unlike in the time-invariant case, time-varying differential equations 


generally do not have closed-form solutions. Let us investigate the properties 
of a time-varying system by considering a scalar homogeneous state equation, 


at) _ = a(t)x(1) (4-505) 
This equation can be solved by first separating the variables, 
dx(t) __ z 
. 7 a a(t) dt (5-506) 
and then integrating both sides to get 
In x(t) — In x(t.) = { * a(t) dt (4-507) 
Therefore, . 
x(t) = exp f° a(t) dt |x.) (4-508) 


where ¢, denotes the initial time. 
Just as in the time-invariant situation, we can define a state transition 
matrix for the time-varying state equation. For the scalar case under considera- 
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tion, the state transition matrix is 
P(t, to) = exp f a(t) dt (4-509) 
to 


Notice that for the time-varying case, the state transition matrix depends upon 
t and fg, not simply t — fo. 
For the vector-matrix state equation 


x(t) = Ax) (4-510) 
it is simple to show that the solution can be written 
x(t) = (4, to)X(Fo) (4-511) 


where @(f, f)) is the state transition matrix that satisfies Eq. (4-510). However, 
the problem is how to find (f, .) in general. The question is: Is O(r, fo) related 
to the A(t) matrix through the following relationship? 


$(t, ts) = exp [ | : A(t) at| (4-512) 


To answer the posed question, let us expand the right side of Eq. (4-512) 
into a power series, 


exp| f a@an|=1+ [ a@ar +a, [ a@ar | A(a)do +... 


t 
to 


(4-513) 
Taking the derivative on both sides of the last equation with respect to time, 
we have 
a exp | | A(t) ae = A(t) + SAO | A(a) do + > | A(t) dt A(t) +... 
, (4-514) 
Multiplying both sides of Eq. (4-513) by A(r), we have 
A(t) exp [ f A(t) dt | =AQ+AO[ A@dr +... 4515) 
By comparison of Eqs. (4-514) and (4-515), we see that 
£ exp | | A(t) ar| = A(t) exp if A(t) ar| (4-516) 
a 0 ° 
£$(t to) = ADOC, to) (4-517) 
if and only if 
As) | A(t) dt = J A(t) dz A(t) (4-518) 
that is, . ; 
A@) and =f AC) at 
commute. 


The requirement that A(r) and its integral commute is evidently a very 
stringent condition. Therefore, in general, Eq. (4-512) will not be valid. 


Sec. 4.23 State Equations of Linear Time-Varying Systems / 175 


Most of the properties of the time-invariant state transition matrix, 
(t — fg), can be extended to the time-varying case. These are listed as follows: 


1. 6¢,t) =1 
2. O°'(, to) = O(fo, £). 
3. Oto, t1) O41, £0) = P(ta, to) for any fo, fy, f2. 


Solution of the Nonhomogeneous Time-Varying State Equation 


Disregarding the problem of finding the state transition matrix $(t, fo) 
for the moment, we shall solve for the solution of the nonhomogeneous state 
equation of Eq. (4-503). 

Let the solution be 

x(t) = O(¢, to)n(Z) (4-519) 
where 1(¢) is an n X | vector, and (t, ty) is the state transition matrix that 
satisfies Eq. (4-517). Equation (4-519) must satisfy Eq. (4-503). Substitution of 
Eq. (4-519) into Eq. (4-503) yields 


H(t, to)N() + H(t, to.) = A(OOL, t0)N(2) + BUC?) (4-520) 
Substituting Eq. (4-517) into Eq. (4-520) and simplifying, we get 


O(7, fo) M(t) = B(e)u(r) (4-521) 
Thus 
At) = O"'(¢, to) B(r)u(r) (4-522) 
and 
m0) = f° 6c, to)BEOuCe) de + (00) (4-523) 


The vector n(fo) is obtained from Eq. (4-519) by setting t = ¢). Thus substitut- 
ing Eq. (4-523) into Eq. (4-519), we have 


X(C) = O(t, to) (60) + (6 to) f O°1(e, fo)B(r)u(e) dt (4-524) 


Since 

Ct, t6)6-"(t, to) = H(t, t0)b(tos t) = (1, 7) (4-525) 
Eq. (4-524) becomes 

x(0) = O(t, to)xto) + |" (6, DBG@uCe) dt (4-526) 


which is the state transition equation of Eq. (4-503). 


Discrete Approximation of the Linear Time-Varying System 


In practice, not too many time-varying systems can be solved by using 
Eq. (4-526), since O(¢, f,) is not readily available. It is possible to discretize 
the system with a time increment during which the time-varying parameters 
do not vary appreciably. Then the problem becomes that of solving a set of 
linear time-varying discrete state equations. One method of discretizing the 
system is to approximate the derivative of x(t) by 
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X(t) Fixlk 4UT]—xkT)} kT <t<(k+T (4527) 


where T is a small time interval. The state equation of Eq. (4-503) is approxi- 
mated by the time-varying difference equation 


x[(K + 1)T] = A*(KT)x(KT) + BRAT)(AT) (4-528) 
over the time interval, AT < t< (k + WT, where 
A*(kKT) = TA(kT) +1 
B*(kT) = TB(kT) 


Equation (4-528) can be solved recursively in much the same way as in the time- 
invariant case, Eqs. (4-433) through (4-437). 
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PROBLEMS 


4.1. Write state equations for the electric networks shown in Fig. P4-1. 


i(t) C 


Figure P4-1. 


4.2. The following differential equations represent linear time-invariant systems. 
Write the dynamic equations (state equations and output equation) in vector- 
matrix form. 
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d? c(t) 34) 


(a) Gn + c(t) =r(t) 
(oy SA + oie) + Sele) = r(t) 
() 3) re sae ey = #O 


(6) FA 5 2A ett) + ( etdt = re) 


(e) TO +6 i + Se(t) = 2 


4.3. Using Eq. a show that 
$@) =1+ Att 5 yar + 7% of 


+ r(t) 


4.4. The state equations of a linear time-invariant system are represented by 
x() = Ax(t) + Bu(t) 


Find the state transition matrix @(¢) for the following cases: 


(a) a=[ 0 oO B=[1| 
—-1 —2| | 1 
(b) a-[ 0 1] B-(?] 
—2 -—3] 4 
(c) re Pg 07 es * | 
0 —2] 1 
(d) —1 1 0 0 
A=| 0 —1 1 B=] 0 
0 oO -1 1 


4.5. Find the state transition equations for the systems described in Problem 4.4 
for ¢ > 0. It is assumed that x(0+) is given and u(¢) is a unit step function. 
4.6. Given the state equation 


x() = Ax(t) + Bu(t) 


where 
00 1 0 
A=+/1 0 -1 B=] 0 
2 1 0 1 


find the transformation such that the state equation becomes 
y(t) = Ayx(t) + By u(t) 
where A, and B, are in the phase-variable canonical form. 
4.7. For the state equation given in Problem 4.6, if 


1 0 0 0 
A= 0 1 0 B=/0 
—2 -3 -1 1 


can the state equation be transformed into the phase-variable form? Explain. 
4.8. Given the state equations of a linear time-invariant system as 


x(t) = Ax(t) + Bu(r) 
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4.9, 


4.10. 


4.11. 


4.12. 


where 
0 1 0 0 
A=/0 0 1 B=| 0 
0 -—2 -3 1 


determine the transfer function relation between X(s) and U(s). Find the 
eigenvalues of A. 


For a linear time-invariant system whose state equations have coefficient 
matrices given by Eqs. (4-111) and (4-112) (phase-variable canonical form), 
show that 


adj (sl — A)B = 


sg” 1 
and the characteristic equation is : 
s™ + ays"! + angst? +... + ayi8 + a, == 9. 
A closed-loop control system is described by 
X(t) = Ax(t) + Bu(7) 
u(t) = —Gx(f) 


where x(‘) = n-vector, u(t) = r-vector, A is n Xn, Bis n Xr, and G is the 
r X n feedback matrix. Show that the roots of the characteristic equation are 
eigenvalues of A — BG. Let 


0 1 0 0 0 

0 0 1 0 0 
A = = 

0 0 0 1 2 0 

0 —2 -—5 —10 1 


=[g: 82 8&3 gal 


Find the characteristic equation of the closed-loop system. Determine the 
elements of G so that the eigenvalues of A — BG are at —1, —2, —1 — jl, and 
—1 + 1. Can all the eigenvalues of A — BG be arbitrarily assigned for this 
problem? 


A linear time-invariant system is described by the following differential equa- 
tion: 
d2c(t) 


a a dc) + c(t) = r() 


(a) Find the state transition matrix $(¢). 

(b) Let c(0) = 1, ¢(0) = 0, and r(t) = u,(0), the unit step function; find the 
state transition equations for the system. 

(c) Determine the characteristic equation of the system and the eigenvalues. 


A linear multivariable system is described by the following set of differential 
equations: 
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dc,(t) 


> f= avo) 
~ dt? 


+ 2e1(t) — 2e2(t) = ri) 


ie — c(t) + e2(t) = r.(t) 


(a) Write the state equations of the system in vector-matrix form. Write the 
output equation in vector-matrix form. 
(b) Find the transfer function between the outputs and the inputs of the system. 


4.13. Given the state transition equation x(t) = Ax(rt), where 


rom & a 
@ Co 
o and @ are real numbers. 
(a) Find the state transition matrix (¢). 
(b) Find the eigenvalues of A. 
(c) Find the eigenvectors of A. 


4.14. Given the state equations of a linear system as 
x(t) = Ax(t) + Bu(r) 


where 
0 1 0 0 
A= 0 0 1 B=| 0 
—6 -l11l —6 1 
The eigenvalues of A are A, = —1,A, = —2,4,; = —3. Finda transformation 


x(t) = Py(f) that will transform A into a diagonal matrix A = diag [A, A, A3}. 
4.15. Given a linear system with the state equations described by 
x(t) = Ax(t) + Bu(t) 


where 
0 1 0 0 
A= 0 0 1 B=|0 
—25 ~-35 —11 1 
The eigenvalues are 2, = —1, A, = —5, A; = —5. Find the transformation 


x(t) = Py(t) so that A is transformed into the Jordan canonical form. The 
transformed state equations are 
y(t) = Ay@) + Tu(r) 
Find A and TI. 
4.16 Draw state diagrams for the following systems: 
(a) x(t) = Ax(t) + Bu(r) 


—3 2 0 0 
A=j;-1 -1 1 B=] 0 
-5 -—-2 -1 1 
(b) X(t) = Ax(t) + Buz). Same A as in part (a) but with 
0 1 
B=/1 0 
i 0 


4.17. The block diagram of a feedback control system is shown in Fig. P4-17. 
(a) Write the dynamic equations of the system in vector-matrix form. 
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4.18. 


4.19. 


4.20. 


4.21, 


4,22. 


Figure P4-17. 


(b) Draw a state diagram for the system. 

(c) Find the state transition equations for the system. Express the equations in 
matrix form. The initial states are represented by x(¢}), and the input r(r) 
is a unit step function, u,(t — fo), which is applied at r == fo. 

Draw state diagrams for the following transfer functions by means of direct 

decomposition: 

10 


@) OS) = Sas + as + 10 

—_ &s+1) 
©) 6S) = GS De +3 
Write the state equations from the state diagrams and express them in the 
phase-variable canonical form. 
Draw state diagrams for the following systems by means of parallel decom- 
position: 


_ _ 6s + I) 
@ OO) = Set HE+D 
(b) ce) + 60 + Se(t) = 20 +r) 


Write the state nar en from ie state diagrams and show that the states are 
decoupled from each other. 


Draw state diagrams for the systems in Problem 4.19 by means of cascade 
decomposition. 
Given the transfer function of a linear system, 
10(s + 1) 

C9) = GORE FS 
Draw state diagrams for the system using three different methods of decom- 
position. The state diagrams should contain a minimum number of integrators. 
The state diagram of a linear system is shown in Fig. P4-22. 


Figure P4-22. 
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4.23. 


4.24. 
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(a) Assign the state variables and write the dynamic equations of the system. 
(b) Determine the transfer function C(s)/R(s). 


Draw state diagrams for the electric network shown in Fig. P4-1. 
The state diagram of a linear system is shown in Fig. P4-24. 


4.25, 


4.26. 


4.27. 


Figure P4-24. 


(a) Assign state variables on the state diagram; create additional nodes if 
necessary, as long as the system is not altered. 
(b) Write the dynamic equations for the system. 
Given the state equation 
x(t) = Ax(t) 


where 
—2 1 0 
A= 0 -—2 1 
0 0 -2 


(a) Find the eigenvalues of A. 
(b) Determine the state transition matrix $(¢). 


Given the state equation 
x(t) = Ax(t) + Bu(t) 


where 
0 1 0 0 
A= 0 0 1 B=| 0 
—2 -4 -3 1 


The eigenvalues of A are A; = —1, A, = —1 —j1, A; = —1 +/1. Find the 
transformation x(t) = Py(t) which transforms A into the modal form 


-1 0 0 
A= 0 -1 1| = P-'AP 
0 -1 -Il 


Given the linear system 
x@) = Ax(t) + Bu(t) 
where u(t) is generated by state feedback, 
u(t) = —Gx(t) 

The state transition matrix for the closed-loop system is 

Gf) = eA-BO = L-I(T — A + BG)-*) 
Is the following relation valid? 

e(A-BG): = eAte—BGr 
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4.28. 


where 
eMt = £-1[(61 — A)-] 
e 8G: — L-1[(sI + BG)-') 
Explain your conclusions. 


Determine the state controllability of the system shown in Fig. P4-28. 


4.29. 


4.30. 


4.31. 


Figure P4-28. 


(a) @a=1,b5 =2,c =2,andd=1. 

(b) Are there any nonzero values for a, b, c, and d such that the system is not 
completely state controllable? 

Figure P4-29 shows the block diagram of a feedback control system. Determine 


the state controllability and observability of the system by the following 
methods, whenever applicable: 


Figure P4-29. 


(a) Conditions on the A, B, D, and E matrices. 
(b) Transfer function. 
(c) Coupling of states. 
The transfer function of a linear system is given by 
C@)___s+a 
Rs) s3- + 6s? + tls + 6 
(a) Determine the value of a so that the system is either uncontrollable or 
unobservable. 
(b) Define the state variables so that one of them is uncontrollable. 
(c) Define the state variables so that one of the states is unobservable. 


Consider the system described by the state equation 
x(t) = Ax(t) + Bu(®) 
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elie Pel 
~—lia b 
Find the region in the a-versus-b plane such that the system is completely 


controllable. 


4.32. Draw the state diagram of a second-order system that is neither controllable nor 
observable. 


4.33. Determine the conditions on 5,, 62, d;, and dz so that the following system is 
completely state controllable, output controllable, and observable: 


x(t) = Ax(t) + But) 


ol eal 
0 1 by 
c(t) = Dx(t) 
D=[d 4) 


4.34. The block diagram of a simplified control system for the Large Space Telescope 
(LST) is shown in Fig. P4-34. For simulation and control purposes, it would 
be desirable to represent the system by state equations and a state diagram. 


where 


Gimbal Control moment 
controller gyro dynamics 


Vehicle 
position 


Command 


Vehicle 
dynamics 


Figure P4-34. 


(a) Draw a state diagram for the system and write the state equations in vector- 
matrix form. 

(b) Find the characteristic equation of the system. 

(c) A modern control design scheme, called the state feedback, utilizes the 
concept of feeding back every state variable through a constant gain. In 
this case the control law is described by 


e=Pr — 81% 82X2 833 84aX4 
Find the values of g,, 22, g3, and g4 such that the eigenvalues of the overall 
system are at s 100, —200, —1 +/1, —1 —/1. The system parameters 
are given as H = 600, K; = 9700, Je =2, J, = 105, K, = 216, and 
Ky = 300. All units are consistent. 
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4.35. The difference equation of a linear discrete-data system is given by 
cl(k + 2)T] + 0.5c[(K + IT] + 0.1c(KT) = 


(a) Write the state equations for the system. 

(b) The initial conditions are given as c(0) = 1 and c(T) = 0. Find c(kT) for 
k =2,3,...,10 by means of recursion. Can you project the final value of 
c(kT) from the recursive results? 


4.36. Given the discrete-data state equations, 
x(k + 1) = 0.1x2(k) 
x2(k + 1) = —x1(k) + 0.7x2(k) + r(k) 
find the state transition matrix (4). 
4,37. A discrete-data system is characterized by the transfer function 


C(z) __ Kz 
RQ) (z — 1)? —z + 3) 
(a) Draw a state diagram for the system. 
(b) Write the dynamic equation for the system in vector-matrix form. 
4.38. The block diagram of a discrete-data control system is shown in Fig. P4-38. 


2(s + 0.5) 
s(s + 0.2) 


Figure P4-38. 


(a) Draw a state diagram for the system. 
(b) Write the state equations in vector-matrix form, 


x((K + 1)T] = O(T)x(KT) + O(T)r (KT) 
(c) Find (7) when T = 0.1 sec. 


5 


Mathematical Modeling 


5.1 


of Physical Systems 


Introduction 


One of the most important tasks in the analysis and design of control systems is 
the mathematical modeling of the systems. In preceding chapters we have intro- 
duced a number of well-known methods of modeling linear systems. The two 
most common methods are the transfer function approach and the state-variable 
approach. However, in reality most physical systems have nonlinear charac- 
teristics to some extent. A physical system may be portrayed by a linear mathe- 
matical model only if the true characteristics and the range of operation of the 
system justify the assumption of linearity. 

Although the analysis and design of linear control systems have been well 
developed, their counterparts for nonlinear systems are usually quite complex. 
Therefore, the control systems engineer often has the task of determining not 
only how to accurately describe a system mathematically, but, more important, 
how to make proper assumptions and approximations, whenever necessary, so 
that the system may be adequately characterized by a linear mathematical model. 

It is important to point out that the modern control engineer should place 
special emphasis on the mathematical modeling of the system so that the analysis 
and design problems can be adaptable for computer solutions. Therefore, the 
main objectives of this chapter are 


1. To demonstrate the mathematical modeling of control systems and 
components. 
2. To demonstrate how the modeling will lead to computer solutions. 
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The modeling of many system components and control systems will be 
illustrated in this chapter. However, the emphasis is placed on the approach to 
the problem, and no attempt is being made to cover all possible types of systems 
encountered in practice. 


5.2 Equations of Electrical Networks 


The classical way of writing network equations of an electrical network is the 
loop method and the node method, which are formulated from the two laws of 
Kirchhoff. However, although the loop and node equations are easy to write, 
they are not natural for computer solutions. A more modern method of writing 
network equations is the state-variable method. We shall treat the subject briefly 
in this section. More detailed discussions on the state equations of electrical 
networks may be found in texts on network theory.!:? 

Let us use the RLC network of Fig. 5-1 to illustrate the basic principle of 


Fig. 5-1. RLC network. 


writing state equations for electric networks. It is relatively simple to write the 
loop equation of this network: 


2 
e() = LEW 5 RMD 4 Fay (5-1) 
dt Cc 
where q(t) is the electric charge and is related to the current i(t) by 
a(t) = { ic)de (5-2) 
0) 


It is shown in Chapter 4 that the second-order differential equation in 
Eq. (5-1) can be replaced by two first-order differential equations called the 
state equations. In this case it is convenient to define the state variables as 


x,() = =e) (5-3) 
where e,(t) is the voltage across the capacitor and 
lives da) _ i(t) = CPO ax) (5-4) 
Substituting Eqs. (5-3) and (5-4) into Eq. (5-1) yields 
et) = LO + Rx + x10) (5-5) 
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Thus, from Eqs. (5-4) and (5-5) the state equations of the network are 


dx(t)_ 1 
de = CHO en 
#2) . 1509 — Bey + Len (5-7) 


A more direct way of arriving at the state equations is to assign the current 
in the inductor L, i(t), and the voltage across the capacitor C, e,(t), as the state 
variables. Then the state equations are written by equating the current in C and 
the voltage across L in terms of the state variables and the input source. This way 
the state equations are written by inspection from the network. Therefore, 


Current in C: Cc de.(6) = i(t) (5-8) 
P di(t) : ‘ 
Voltage across L: L a7 —e,(t) — Ri(t) + e(t) (5-9) 


Since x,(¢) = e,(t) and x,(¢) = i(2), it is apparent that these state equations are 
identical to those of Eqs. (5-6) and (5-7). 

In general, it is appropriate to assign the voltages across the capacitors and 
currents in the inductors as state variables in an electric network, although there 
are exceptions.!:? 

One must recognize that the basic laws used in writing state equations for 
electric networks are still the Kirchhoff’s laws. Although the state equations in 
Eqs. (5-8) and (5-9) are arrived at by inspection, in general, the inspection method 
does not always work, especially for complicated networks. However, a general 
method using the theory of linear graphs of network analysis is available.! 


EXAMPLE 5-1 _—As another example of writing the state equations of an electric net- 
work, consider the network shown in Fig. 5-2. According to the 
foregoing discussion, the voltage across the capacitor e, and the cur- 

rents in the inductors i, and i, are assigned as state variables, as shown in Fig. 5-2. 


Fig. 5-2. Network in Example 5-1. 


The state equations of the network are obtained by writing the voltages across the 
inductors and the currents in the capacitor in terms of the three state variables. The 
state equations are 


£, BO = Rilo — et) +e) (5-10) 
1, BO — — Rai) + es) (5-11) 
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c&O 


=i) — bn) (5-12) 


Rearranging the constant base the state equations are written in the following 
canonical form: 


di,(t) p Ri Ay, 7 
dt Be, oO Sa | 
din(t) | _ _R Be 1 
> ral oe 0 L, L, in(t) | + L, 0 |e(t) (5-13) 
de,{t) 1 1 
dt L rel = vel 0 e(t) 0 | 


5.3 Modeling of Mechanical System Elements? 


Most feedback control systems contain mechanical as well as electrical com- 
ponents. From a mathematical viewpoint, the descriptions of electrical and 
mechanical elements are analogous. In fact, we can show that given an electrical 
device, there is usually an analogous mechanical counterpart, and vice versa. 
The analogy, of course, is a mathematical one; that is, two systems are analo- 
gous to each other if they are described mathematically by similar equations. 

The motion of mechanical elements can be described in various dimensions 
as translational, rotational, or a combination of both. The equations governing 
the motions of mechanical systems are often directly or indirectly formulated 
from Newton’s law of motion. 


Translational Motion 


The motion of translation is defined as a motion that takes place along a 
straight line. The variables that are used to describe translational motion are 
acceleration, velocity, and displacement. 

Newton’s law of motion states that the algebraic sum of forces acting on a 
rigid body in a given direction is equal to the product of the mass of the body and 
its acceleration in the same direction. The law can be expressed as 


= forces = Ma (5-14) 


where M denotes the mass and a is the acceleration in the direction considered. 
For translational motion, the following elements are usually involved: 


1. Mass: Mass is considered as an indication of the property of an 
element which stores the kinetic energy of translational motion. It is 
analogous to inductance of electrical networks. If W denotes the 
weight of a body, then M is given by 


ee 


& 
where g is the acceleration of the body due to gravity of the accelera- 
tion of free fall. Three consistent sets of units for the elements in Eqs. 
(5-14) and (5-15) are as follows: 


(5-15) 
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Units Mass M Weight W Acceleration Force 
MKS newtons/m/sec2 newton m/sec2 newton 
CGS dynes/cm/sec2 dyne cm/sec? dyne 
British lb/ft/sec? (slug) lb ft/sec? Ib 

yt) Figure 5-3 illustrates the situation where a force is 


acting on a body with mass M. The force equation is 


@yt) _ yy ae) 
dt 


f(t) = Ma() = mo 


where y(t) represents displacement, v(t) the velocity, and 
a(t) is the acceleration, all referenced in the direction of the 
applied force. 
2. Linear spring: A linear spring in practice may be an actual spring or 
the compliance of a cable or a belt. In general, a spring is considered 
to be an element that stores potential energy. It is analogous to a 
capacitor in electric networks. In practice, all springs are nonlinear 
to some extent. However, if the deformation of a spring is small, its 
behavior may be approximated by a linear relationship, 


fO = ky (5-17) 
where K is the spring constant, or simply stiffness. The three unit 
systems for the spring constant are: 


(5-16) 


Fig. 5-3. Force-mass system. 


Units K 

MKS newtons/m 
CGS dynes/cm 
British lb/ft 


Equation (5-17) implies that the force acting on the spring is directly 
proportional to the displacement (deformation) of the 


spring. The model representing a linear spring element 
Z K make is shown in Fig. 5-4. 
fo If the spring is preloaded with a preload tension of 
T, then Eq. (5-17) should be modified to 
Fig. 5-4, Force-spring system. fi) —T= Ky(t) (5-18) 


Friction for translational motion. Whenever there is motion or tendency 
of motion between two elements, frictional forces exist. The frictional forces 
encountered in physical systems are usually of a nonlinear nature. The charac- 
teristics of the frictional forces between two contacting surfaces often depend 
on such factors as the composition of the surfaces, the pressure between the 
surfaces, their relative velocity, and others, so that an exact mathematical 
description of the frictional force is difficult. However, for practical purposes, 
frictional forces can be divided into three basic catagories: viscous friction, 
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static friction, and Coulomb friction. These are discussed separately in detail in 
the following. 


1. 


B jp» y(t) 


Viscous friction. Viscous friction represents a retarding force that is 
a linear relationship between the applied force and velocity. The 
schematic diagram element for friction is often repre- 
sented by a dashpot such as that shown in Fig. 5-5. The 


ss mathematical expression of viscous friction is 
>I» po=nP sip 


where B is the viscous frictional coefficient. The dimen- 


Fig. 5-5. Dashpot for viscous friction. 


3. 


(a) 


sions of B in the three unit systems are as follows: 


Units B 

MKS newton/m/sec 
CGS dyne/cm/sec 
British lb/ft/sec 


Figure 5-6(a) shows the functional relation between the viscous 
frictional force and velocity. 

Static friction. Static friction represents a retarding force that tends 
to prevent motion from beginning. The static frictional force can be 
represented by the following expression: 


f) = EF )y-0 (5-20) 
where (F,),.. is defined as the static frictional force that exists only 
when the body is stationary but has a tendency of moving. The sign 
of the friction depends on the direction of motion or the initial 
direction of velocity. The force-velocity relation of static friction is 
illustrated in Fig. 5-6(b). Notice that once motion begins, the static 
frictional force vanishes, and other frictions take over. 

Coulomb friction. Coulomb friction is a retarding force that has a 


(b) (c) 


Fig. 5-6. Functional relationships of linear and nonlinear frictional forces. 


(a) 


Viscous friction. (b) Static friction. (c) Coulomb friction. 
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constant amplitude with respect to the change in velocity, but the 
sign of the frictional force changes with the reversal of the direction 
of velocity. The mathematical relation for the Coulomb friction is 

ar) (5-21) 


given by 
— p(y 
sO = F(2)2 


where F, is the Coulomb friction coefficient. The functional descrip- 
tion of the friction to velocity relation is shown in Fig. 5-6(c). 


Rotational Motion 


The rotational motion of a body may be defined as motion about a fixed 
axis. The variables generally used to describe the motion of rotation are torque; 
angular acceleration, a; angular velocity, q@; and angular displacement, @. The 
following elements are usually involved with the rotational motion. 


Inertia. Inertia, J, is considered as an indication of the property of an 
element which stores the kinetic energy of rotational motion. The inertia of a 
given element depends on the geometric composition about the axis of rotation 
and its density. 

For instance, the inertia of a circular disk or a circular shaft about its geo- 
metric axis is given by 

J = 4Mr? (5-22) 


where M is the mass of the disk or shaft and r is its radius. 
EXAMPLE 5-2 Given a disk that is 1 in. in diameter, 0.25 in. thick, and weighing 5 
02, its inertia is 


1 Wr? _ 1 (S02)(1 in)? 
2g 2 386 injsec? (5-23) 


= 0.00647 oz-in-sec” 


J= 


Usually the density of the material is given in weight per unit volume. Then, for a 
circular disk or shaft it can be shown that the inertia is proportional to the fourth 
power of the radius and the first power of the thickness or length. Therefore, if the 
weight W is expressed as 

W = p(ar2h) (5-24) 


where p is the density in weight per unit volume, r the radius, and A the thickness or 
length, then Eq. (5-22) is written 


Jat Pree = 0.00406p hr (5-25) 


where A and r are in inches. 
For steel, p is 4.53 oz/in?; Eq. (5-25) becomes 


J = 0.0184 hr4 (5-26) 
For aluminum, p is 1.56 oz/in?; Eq. (5-25) becomes 
J = 0.00636 Ar4 (5-27) 
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When a torque is applied to a body with inertia J, 
To) as shown in Fig. 5-7, the torque equation is written 
2, 
a) TQ) = Jatt) = 720 — 7 FO) 6-28) 


The three generally used sets of units for the quan- 
Fig. 5-7. Torque-inertia system. tities in Eq. (5-28) are tabulated as follows: 


Units Inertia Torque Angular Displacement 
MKS kg-m2 newton-m radian 
CGS g-cm2 dyne-cm radian 
English slug-ft2 lb-ft 
or Ib-ft-sec? 
OZ-in-sec? oz-in radian 


The following conversion factors are often found useful: 


Angular displacement. 


Lrad — 180 _ 57.3° 
v4 


Angular velocity. 


1 rpm = 60 = 0.1047 rad/sec 


1 rpm = 6 deg/sec 


Torque. 
1 g-cm = 0.0139 oz-in 
1 Ib-ft = 192 oz-in 
1 oz-in = 0.00521 Ib-ft 
Inertia. 


1 g-cm? = 1.417 x 10°° oz-in-sec? 
1 Ib-ft-sec? = 192 oz-in-sec? 
1 oz-in-sec? = 386 oz-in? 
1 g-cm-sec? = 980 g-cm? 
1 Ib-ft-sec? = 32.2 lb-ft? 
Torsional spring. As with the linear spring for translational motion, a 


torsional spring constant K, in torque per unit angular 
displacement, can be devised to represent the compliance 


4 qT 
K (of a rod or a shaft when it is subject to an applied 
torque. Figure 5-8 illustrates a simple torque-spring 
a(t) system that can be represented by the following equa- 


Fig. 5-8. Torque-torsional spring tion: 
system. T() = K@() (5-29) 
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The dimension for K is given in the following units: 


Units K 

MKS newton-m/rad 
CGS dyne-cm/rad 
British oz-in/rad 


If the torsional spring is preloaded by a preload torque of 7P, Eq. (5-29) is 
modified to 
T(t) — TP = K@(t) (5-30) 


Friction for rotational motion. The three types of friction described for 
translational motion can be carried over to the motion of rotation. Therefore, 
Eqs. (5-19), (5-20), and (5-21) can be replaced, respectively, by their counter- 
parts: 


T(t) = Ea) (5-31) 

T(t) = 1(F,)en-0 (5-32) 
_ (a6 |\a0 

T(t) = r(G ¢ ) (5-33) 


where B is the viscous frictional coefficient in torque per unit angular velocity, 
(F,)gao is the static friction, and F, is the Coulomb friction coefficient. 


Relation Between Translational and Rotational Motions 


In motion control problems it is often necessary to convert rotational mo- 
tion into a translational one. For instance, a load may be controlled to move 
along a straight line through a rotary motor and screw assembly, such as that 
shown in Fig. 5-9. Figure 5-10 shows a similar situation in which a rack and 


T(t), @(t) p—> x(t) 


Fig. 5-9. Rotary-to-linear motion-control system. 


}—» x(t) 
PA AAA AAA AT AVVAVAYAAAYATAATAYATATAYAYA’ATATATATANAN 
a(t) 


Drive 
motor mm 


Fig. 5-10. Rotary-to-linear motion-control system. 
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Fig. 5-11. Rotary-to-linear motion-control system. 


pinion is used as the mechanical linkage. Another common system in motion 
control is the control of a mass through a pulley by a rotary prime mover, such 
as that shown in Fig. 5-11. The systems shown in Figs. 5-9, 5-10, and 5-11 can 
all be represented by a simple system with an equivalent inertia connected 
directly to the drive motor. For instance, the mass in Fig. 5-11 can be regarded as 
a point mass which moves about the pulley, which has a radius r. Disregarding 
the inertia of the pulley, the equivalent inertia that the motor sees is 


J = Mr = er (5-34) 


If the radius of the pinion in Fig. 5-10 is r, the equivalent inertia which the 
motor sees is also given by Eq. (5-34). 

Now consider the system of Fig. 5-9. The lead of the screw, L, is defined as 
the linear distance which the mass travels per revolution of the screw. In prin- 
ciple, the two systems in Fig. 5-10 and 5-11 are equivalent. In Fig. 5-10, the 
distance traveled by the mass per revolution of the pinion is 2zr. Therefore, 
using Eq. (5-34) as the equivalent inertia for the system of Fig. 5-9, 

W/(L\ 
= =(s) (5-35) 
where in the British system 
J = inertia (oz-in-sec?) 
W = weight (oz) 
LL = screw lead (in) 
g = gravitational force (386.4 in/sec?) 


Mechanical Energy and Power 


Energy and power play an important role in the design of electromechanical 
systems. Stored energy in the form of kinetic and potential! energy controls the 
dynamics of the system, whereas dissipative energy usually is spent in the form of 
heat, which must be closely controlled. 

The mass or inertia of a body indicates its ability to store kinetic energy. 
The kinetic energy of a moving mass with a velocity v is 


W, = 4Mv> (5-36) 


The following consistent sets of units are given for the kinetic energy rela- 
tion: 
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Units Energy Mass Velocity 
MKS joule or newton/m/sec2 m/sec 
newton-m 
CGS dyne-cm dyne-cm-sec? cm/sec 
British ft-lb Ib/ft/sec2 ft/sec 
(slug) 


For a rotational system, the kinetic energy relation is written 
W, = 4J@ (5-37) 


where J is the moment of intertia and @ the angular velocity. The following 
units are given for the rotational kinetic energy: 


Units Energy Inertia Angular Velocity 
MKS joule or kg-m2 rad/sec 
newton-m 
CGS dyne-cm gm-cm2 rad/sec 
British oz-in oz-in-sec2 tad/sec 


Potential energy stored in a mechanical element represents the amount of 
work required to change the configuration. For a linear spring that is deformed 
by y in length, the potential energy stored in the spring is 

W, = 4Ky? (5-38) 
where K is the spring constant. For a torsional spring, the potential energy 
stored is given by 

W, = 4K@? (5-39) 

When dealing with a frictional element, the form of energy differs from the 
previous two cases in that the energy represents a loss or dissipation by the sys- 
tem in overcoming the frictional force. Power is the time rate of doing work. 


Therefore, the power dissipated in a frictional element is the product of force 
and velocity; that is, 


P= fv (5-40) 
Since f= Bv, where B is the frictional coefficient, Eq. (5-40) becomes 
P= By? (5-41) 


The MKS unit for power is in newton-m/sec or watt; for the CGS system it is 
dyne-cm/sec. In the British unit system, power is represented in ft-lb/sec or 
horsepower (hp). Furthermore, 
1 hp = 746 watt 
= 550 ft-lb/sec 
Since power is the rate at which energy is being dissipated, the energy dis- 
sipated in a frictional element is 


W,=B [ v dt (5-43) 


(5-42) 
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Gear Trains, Levers, and Timing Belts 


A gear train, a lever, or a timing belt over pulleys is a mechanical device 
that transmits energy from one part of a system to another in such a way that 
force, torque, speed, and displacement are altered. These devices may also be 
regarded as matching devices used to attain maximum power transfer. Two 
gears are shown coupled together in Fig. 5-12. The inertia and friction of the 
gears are neglected in the ideal case considered. 

The relationships between the torques 7, and 7,, angular displacements 
0, and @,, and the teeth numbers N, and N,, of the gear train are derived from 
the following facts: 


1. The number of teeth on the surface of the gears is proportional to the 
radii r, and r, of the gears; that is, 
r,N2 = rN, (5-44) 


2. The distance traveled along the surface of each gear is the same. 
Therefore, 


Air, = O2r2 (5-45) 


3. The work done by one gear is equal to that of the other since there 
is assumed to be no loss. Thus 


T,0, = 7T.0, (5-46) 
qT, Fa 
T,, 9; Ny ( 
Z 2 
Jy 
Ty, Oy For 94 
Fig. 5-12. Gear train. Fig. 5-13, Gear train with friction and inertia. 


If the angular velocities of the two gears, w, and @,, are brought into the 
picture, Eqs. (5-44) through (5-46) lead to 


T, 9, Ni _ @ "Y (5-47) 


T, 0, MN, a 
In practice, real gears do have inertia and friction between the coupled gear 
teeth which often cannot be neglected. An equivalent representation of a gear 
train with viscous friction, Coulomb friction, and inertia considered as lumped 
elements is shown in Fig. 5-13. The following variables and parameters are 
defined for the gear train: 
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T = applied torque 
6,,0, = angular displacements 
T,, T, = torque transmitted to gears 
J,, J, = inertia of gears 
N,, N, = number of teeth 
F.,, F.. = Coulomb friction coefficients 
B,, B, = viscous frictional coefficients 


The torque equation for gear 2 is written 


TA) = J, £20 + 5,820 + F., oy : (5-48) 
2 
The torque equation on the side of gear 1 is 
7) = J, OO + 2, BO . F, ae (+10 (5-49) 


By the use of Eq. (5-47), Eq. (5-48) is converted to 
LO) i) (0 4 Nip d, : 
TiC) = RATAO) = (yt) Ja Gee + (Ht) Ba SO + the BA (550) 
Equation (5-50) indicates that it is possible to reflect inertia, friction, (and com- 
pliance) torque, speed, and displacement from one side of a gear train to the 
other. 
Therefore, the following quantities are obtained when reflecting from gear 


2 to gear |: 
- x) 
Inertia: a J, 


2 
Viscous frictional coefficient: (#) B, 
2 


Torque: Pa T, 
Angular displacement: Nig, 
2 
Angular velocity: Nia, 
N, 


Coulomb frictional torque: Wt Fea eer Toul 
2 

If torsional spring effect were present, the spring eet is also multiplied by 

(N,/N,2)* in reflecting from gear 2 to gear 1. Now, substituting Eq. (5-50) into 

Eq. (5-49), we get 


TH) = J, THO + 2,80 + 7, (5-51) 
where 
2 
‘ane pee (¥) Jo (5-52) 
2 
Bi, + (7) B, (5-53) 
Tp = F,oe 4 Nip, 92 (5-54) 
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EXAMPLE 5-3. Given a load that has inertia of 0.05 oz-in-sec? and a Coulomb fric- 
tion torque of 2 oz-in, find the inertia and frictional torque reflected 
through a 1:5 gear train (N,/N2 = 4 with N, on the load side). The 

reflected inertia on the side of N, is (4)? xX 0.05 = 0,002 oz-in-sec?, The reflected 

Coulomb friction is (4)2 = 0.4 oz-in. 


Timing belts and chain drives serve the same purposes as the gear train 
except that they allow the transfer of energy over a longer distance without using 
an excessive number of gears. Figure 5-14 shows the diagram of a belt or chain 
drive between two pulleys. Assuming that there is no slippage between the belt 
and the pulleys, it is easy to see that Eq. (5-47) still applies to this case. In fact, 
the reflection or transmittance of torque, inertia, friction, etc., is similar to that of 
a gear train. 


- xy 
— fi 1 
Q 
= 
a 
Q 
qT , 6, T, > 0 2 
(©) fy 
es x 
Fig. 5-14. Belt or chain drive. Fig. 5-15. Lever system. 


The lever system shown in Fig. 5-15 transmits translational] motion and 
force in the same way that gear trains transmit rotational motion. The relation 
between the forces and distances is 


fila a 5-55 
fr I x ( ) 
Backlash and Dead Zone 
Backlash and dead zone usually play an important 
> x(t) : a = a js 
role in gear trains and similar mechanical linkages. In a 


TT |—~ y(t) great majority of situations, backlash may give rise to 
b undesirable oscillations and instability in control systems. 
2 In addition, it has a tendency to wear down the mechan- 
ical elements. Regardless of the actual mechanical ele- 
ments, a physical model of backlash or dead zone between 
Fig. 5-16. Physical model of backlash 40 input and an output member is shown in Fig. 5-16. 


between two mechanical elements. The model can be used for a rotational system as well as 


Sec. 5.3 Modeling of Mechanical System Elements / 201 


for a translational system. The amount of backlash is b/2 on either side of the 
reference position. 

In general, the dynamics of the mechanical linkage with backlash depend 
upon the relative inertia-to-friction ratio of the output member. If the inertia of 
the output member is very small compared with that of the input member, the 
motion is controlled predominantly by friction. This means that the output 
member will not coast whenever there is no contact between the two members. 
When the output is driven by the input, the two members will travel together 
until the input member reverses its direction; then the output member will 
stand still until the backlash is taken up on the other side, at which time it is 
assumed that the output member instantaneously takes on the velocity of the 
input member. The transfer characteristic between the input and the output 
displacements of a backlash element with negligible output inertia is shown in 
Figure 5-17. To illustrate the relative motion between the input and the output 


Fig. 5-17. Input-output characteristic of backlash with negligible output 
inertia. 


members, let us assume that the input displacement is driven sinusoidally with 
respect to time. The displacements and velocities of the input and output mem- 
bers are illustrated as shown in Fig. 5-18. Note that the reference position of the 
two members is taken to be that of Fig. 5-16, that is, with the input member 
starting at the center of the total backlash. For Fig. 5-18, it is assumed that 
when motion begins, the input member is in contact with the output member on 
the right, so that x(0) = 0 and y(0) = —b/2. At the other extreme, if the friction 
on the output member is so small that it may be neglected, the inertia of the 
output member remains in contact with the input member as long as the accel- 
eration is in the direction to keep the two members together. When the accelera- 
tion of the input member becomes zero, the output member does not stop 
immediately but leaves the input member and coasts at a constant velocity that is 
equal to the maximum velocity attained by the input member. When the output 
member has traversed a distance, relative to the input member, equal to the full 
width of the backlash, it will be restrained by the opposite side of the input mem- 
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Velocity Output velocity 


0 


i ——__— t 


Input velocity 


Fig. 5-18. Displacement and velocity waveforms of input and output 
members of a backlash element with a sinusoidal input displacement. 


y(t) 


| 
N|o 


A x(t) 


Fig. 5-19. Input-output displacement characteristic of a backlash element 
without friction. 


ber. At that time the output member will again assume the velocity of the input 
member. The transfer characteristic between the input and the output displace- 
ment of a backlash element with negligible output friction is shown in Fig. 
5-19. The displacement, velocity, and acceleration waveforms of the input and 
output members, when the input displacement is driven sinusoidally, is shown in 
Fig. 5-20. 

In practice, of course, the output member of a mechanical linkage with 
backlash usually has friction as well as inertia. Then the output waveforms in 
response to a sinusoidally driven input displacement should lie between those of 
Figs. 5-18 and 5-20. 
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0 a 
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Fig. 5-20. Displacement, velocity, and acceleration waveforms of input 
and output members of a backlash element when the input displacement 
is driven sinusoidally. 


5.4 Equations of Mechanical Systems? 


The equations of a linear mechanical system are written by first constructing a 
model of the system containing interconnected linear elements, and then the 
system equations are written by applying Newton’s law of motion to the free- 
body diagram. 


EXAMPLE 5-4 Let us consider the mechanical system shown in Fig. 5-21(a). The 
free-body diagram of the system is shown in Fig. 5-21(b). The force 


m@ 2y(t) 
dt? 
<= fF yw) 
Ky(t) 
M t 
ay(t) fw) 
dt 
(a) (b) 


Fig. 5-21. (a) Mass-spring-friction system. (b) Free-body diagram. 
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equation of the system is written 
2 
FQ) = MBO + B® + Ky (5-56) 


This second-order differential equation can be decomposed into two first-order state 
equations, using the method discussed in Chapter 4. Let us assign x, = y and x, = 
dy/dt as the state variables. Then Eq. (5-56) is written 


a) =) (5-57) 
fa) — Kx — 4x9 + B10 (5-58) 


It is not difficult to see that this mechanical system is analogous to a series RLC 
electric network. With this analogy it is simple to formulate the state equations direct- 
ly from the mechanical system using a different set of state variables. If we consider 
that mass is analogous to inductance, and the spring constant K is analogous to the 
inverse of capacitance, 1/C, it is logical to assign v(t), the velocity, and f(r), the force 
acting on the spring, as state variables, since the former is analogous to the current in 
an inductor and the latter is analogous to the voltage across a capacitor. 

Then the state equations of the system are 


Force on mass: ay = — Bolt) — fit) -- FC) (5-59) 
Velocity of spring: 7 i) = v(t) (5-60) 


Notice that the first state equation is similar to writing the equation on the voltage 
across an inductor; the second is like that of the current through a capacitor. 

This simple example further illustrates the points made in Chapter 4 regarding 
the fact that the state equations and state variables of a dynamic system are not unique. 


EXAMPLE 5-5 As a second example of writing equations for mechanical systems, 
consider the system shown in Fig. 5-22(a). Since the spring is deformed. 
when it is subjected to the force f(t), two displacements, y, and y2, 

must be assigned to the end points of the spring. The free-body diagrams of the system 

are given in Fig. 5-22(b), From these free-body diagrams the force equations of the 
system are written 


Prez i) 
Y(t) yt) dt? Ya) yy) 

ae 

Y K 
: i 
F kK f®) dra) K(y, — ¥2) fo) 
dt 
(a) (b) 


Fig. 5-22. Mechanical system for Example 5-5. (a) Mass-spring-friction. 
system. (b) Free-body diagrams. 
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f(t) = Kin) — 20) (5-61) 
Ki) — yA) = MEO 5 pO) (5-62) 


Now let us write the state equations of the system. Since the differential equation of 
the system is already available in Eq. (5-62), the most direct way is to decompose this 
equation into two first-order differential equations. 

Therefore, letting x,(t) = y2(t) and x2(t) = dy,(t)/dt, Eqs. (5-61) and (5-62) give 


#19 _ x0 (5-63) 
#2 — _ Bt dpe (5-64) 


As an alternative, we can assign the velocity v(t) of the body with mass M as one 
state variable, and the force f(t) on the spring as the other state variable, so we have 


af) - Buy id ny (5-65) 
and 
fit) =f) (5-66) 


One may wonder at this point if the two equations in Eqs. (5-65) and (5-66) are 
correct as state equations, since it seems that only Eq. (5-65) is a state equation, but we 
do have two state variables in v(t) and f(t). Why do we need only one state equation 
here, whereas Eqs. (5-63) and (5-64) clearly are two independ- 
ent state equations? The situation is better explained (at least 
for electrical engineers) by referring to the analogous electric 
network of the system, shown in Fig. 5-23. It is clear that 
although the network has two reactive elements in Z and C 
and thus there should be two state variables, the capacitance 
in this case is a “redundant” element, since e,(t) is equal to 
the applied voltage e(t). However, the equations in Eqs. (5-65) 
and (5-66) can provide only the solution to the velocity of M 


Fig. 5-23. Electric network analogous once f(t) is specified. If we need to find the displacement y,(t) 
to the mechanical system of Fig. 5-22. at the point where f(r) is applied, we have to use the relation 


vit) = 20 + yy = 4 i u(t) dt + yo(0-+) (5-67) 
0+ 

where y2(0+) is the initial displacement of the body with mass M. On the other hand, 

we can solve for y2(t) from the two state equations of Eqs. (5-63) and (5-64), and then 

yi(t) is determined from Eq. (5-61). 


EXAMPLE 5-6 _ In this example the equations for the mechanical system in Fig. 5-24(a) 
are to be written. Then we are to draw state diagrams and derive 
transfer functions for the system. 

The free-body diagrams for the two masses are shown in Fig. 5-24(b), with the 
reference directions of the displacements y; and y, as indicated. The Newton’s force 
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d ‘ 
Ki (1 — ¥2) a(t = 2 


(a) (b) 


Fig. 5-24. Mechanical system for Example 5-6. 


equations for the system are written directly from the free-body diagram: 


fe) = M, FHO + p [PO — BO) + Koo — Ol 6-68) 
dyi(t) _ dy2(t) 
0= 1 — K,[yi@) — y2(t)l 
=| a dt oi (5-69) 


We may now decompose these two second-order simultaneous differential equations 
into four state equations by defining the following state variables: 


xy =V (5-70) 
1 _ ax 

x2 = “hr ~ dt (6-71) 

X3 = y2 (5-72) 
— Wr _ ax, 

4 dt — at (5-73) 


Equations (5-71) and (5-73) form two state equations naturally; the other two are 
obtained by substituting Eqs. (5-70) through (5-73) into Eqs. (5-68) and (5-69), and 
rearranging we have 


dx 1 


at = X2 (5-74) 
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B 1 
oa — fen — x3) — Fr — x) +7 LO (5-75) 
-_ =X (5-76) 

K. K. 1 
G8 Rha + Bhan — Se Bex, — LB, + Bade (5-77) 
If we are interested in the displacements y,; and y2, the output equations are 
written 

nO = x) (5-78) 
yalt) = x3(t) (5-79) 


The state diagram of the system, according to the equations written above, is 
drawn as shown in Fig. 5-25. The transfer functions Y(s)/F(s) and Y.2(s)/F(s) are 


By /M, 


Fig. 5-25. State diagram for the mechanical system of Fig. 5-24. 


obtained from the state diagram by applying Mason’s gain formula. The reader 
should verify the following results (make sure that all the loops and nontouching loops 
are taken into account): 

Yi(s) = My,s2 + (B, + B,)s + (K; + K,) (5-80) 

F(s) A 

Y2(s)_— Bis + K; 

70 aaa ee (5-81) 
where 
A = M,M,s* + (M(B, + Ba) + BiM, — Bi]s? + [Mi(K, + K,) + KiM, 

+ By(B, + Bo) — By KyJs? + [K,B. + Bi(K, + K2)Js + Ki Ky 
The state equations can also be written directly from the diagram of the mechanical 

system. The state variables are assigned as v, = dy,/dt, v, = dy2/dt, and the forces on 
the two springs, fx1 and fx2. Then, if we write the forces acting on the masses and the 
velocities of the springs, as functions of the four state variables and the external force, 
the state equations are 


Force on M,: M, 


(5-82) 


or = —By, + By. —fer +f (5-83) 
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Force on Mz: Mz? = By; ~ (Bi + Ba)o2 + Sir — fax (5-84) 
Velocity on K,: thes = K,(v, — v2) (5-85) 
Velocity on K2: tes = Kv, (5-86) 


EXAMPLE 5-7 The rotational system shown in Fig. 5-26(a) consists of a disk mounted 
on a shaft that is fixed at one end. The moment of inertia of the disk 
about its axis is J. The edge of the disk is riding on a surface, and 

the viscous friction coefficient between the two surfaces is B. The inertia of the shaft 

is negligible, but the stiffness is K. 


\ Ran 
K J a9 
a 
=~ J | Me 
B ee 
T(t) T(t) ae 
(a) (b) 


Fig. 5-26. Rotational system for Example 5-7. 


Assume that a torque is applied to the disk as shown; then the torque or moment 
equation about the axis of the shaft is written from the free-body diagram of Fig. 
5-26(b): 


d7Ht) pd) 

dt* dt 
Notice that this system is analogous to the translational system of Fig. 5-21. The state 
equations may be written by defining the state variables as x,(t) = O(t) and dx,(t)/dt 
= x,(t). The reader may carry out the next step of writing the state equations as an 
exercise. 


TQ =J + K@(t) (5-87) 


5.5 Error-Sensing Devices in Control Systems*:> 


In feedback control systems it is often necessary to compare several signals at a 
certain point of a system. For instance, it is usually the case to compare the 
reference input with the controlled variable; the difference between the two 
signals is called the error. The error signal is then used to actuate the system. 
The block-diagram notation for the algebraic sum of several signals is defined in 
Fig. 3-5. In terms of physical components, an error-sensing device can be a simple 
potentiometer or combination of potentiometers, a differential gear, a trans- 
former, a differential amplifier, a synchro, or a similar element. The mathematical 
modeling of some of these devices is discussed in the following. 
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Potentiometers. Since the output voltage of a potentiometer is proportional 
to the shaft displacement, when a voltage is applied across its fixed terminals, 
the device can be used to compare two shaft positions. In this case one shaft 
may be fastened to the potentiometer case and the other to the shaft of the 
potentiometer. When a constant voltage is applied to the fixed terminals of the 
potentiometer, the voltage across the variable and the reference terminals will 
be proportional to the difference between the two shaft positions. The arrange- 
ment shown in Fig. 5-27(b) is a one-potentiometer realization of the error-sens- 
ing devices shown in Fig. 5-27(a). A more versatile arrangement may be obtained 
by using two potentiometers connected in parallel as shown in Fig. 5-27(c). This 


6, 1 6. K, 
-1 
(a) 
9, 
+ 
u(t) sama 4, 
e 
= ' 
(b) 


(c) 


Fig. 5-27. (a) Block-diagram and signal-flow-graph symbols for an error 
sensor. (b) Position error sensor using one potentiometer. (c) Position 
error sensor using two potentiometers. 


dc amplifier | ¢ (r) ( M )4e 


Permanent-magnet 
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0 —t 
~ e(t) 
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0 —t 
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0 —t 
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0 —t 


(b) 


Fig. 5-28. (a) Direct current control system with potentiometers as error 
detectors. (b) Typical waveforms of signals in the control system of (a). 


210 


Sec. 5.5 Error-Sensing Devices in Control Systems / 211 


allows comparison of two remotely located shaft positions. The applied voltage 
v(t) can be ac or de, depending upon the types of transducers that follow the 
error sensor. If v(t) is a dc voltage, the polarity of the output voltage e(r) deter- 
mines the relative position of the two shafts. In the case of an ac applied voltage, 
the phase of e(t) acts as the indicator of the relative shaft directions. In either 
case the transfer relation of the two error-sensor configurations can be written 


e(t) = K 80) — 6.0)] (5-88) 
where 
e(t) = error voltage, volts 


K, = sensitivity of the error sensor, volts per radian 


The value of K, depends upon the applied voltage and the total displacement 
capacity of the potentiometers. For instance, if the magnitude of v(t) is V volts 
and each of the potentiometers is capable of rotating 10 turns, K, = V/20z V/rad. 

A simple example that illustrates the use of a pair of potentiometers as an 
error detector is shown in Fig. 5-28(a). In this case the voltage supplied to the 
error detector, v(t), is a dc voltage. An unmodulated or dc electric signal, e(:), 
proportional to the misalignment between the reference input shaft and the 
controlled shaft, appears as the output of the potentiometer error detector. In 
control system terminology, a de signal usually refers to an unmodulated signal. 
On the other hand, an ac signal in control systems is modulated by a modulation 
process. These definitions are different from those commonly used in electrical 
engineering, where dc simply refers to unidirectional and ac indicates alternating. 

As shown in Fig. 5-28(a), the error signal is amplified by a de amplifier 
whose output drives the armature of a permanent-magnet dc motor. If the sys- 
tem works properly, wherever there is a misalignment between the input and the 
output shafts, the motor will rotate in such a direction as to reduce the error to 
a minimum. Typical waveforms of the signals in the system are shown in Fig. 
5-28(b). Note that the electric signals are all unmodulated and the output dis- 
placements of the motor and the load are essentially of the same form as the 
error signal. Figure 5-29(a) illustrates a control system which could serve essen- 
tially the same purpose as that of the system of Fig. 5-28(a) except that ac signals 
prevail. In this case the voltage applied to the error sensor is sinusoidal. The 
frequency of this signal is usually much higher than the frequency of the true 
signal that is being transmitted through the system. Typical signals of the ac 
control system are shown in Fig. 5-29(b). The signal v(r) is referred to as the 
carrier signal whose frequency is @,, or 


v(t) = V sin w,t (5-89) 
Analytically, the output of the error sensor is given by 
e(t) = K,6.(2)v(t) (5-90) 


where @,(t) is the difference between the input displacement and the load dis- 
placement, @,(t) = 6,(t) — 6,(t). For the 6,(4) shown in Fig. 5-29(b), e(t) becomes 
a suppressed-carrier modulated signal. A reversal in phase of e(f) occurs whenever 
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6.(t) Load 
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N 
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Two-phase 
ac motor 
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v(t) V 
0 —t 
~V 
0 -t 
Phase reversals 
e(t) | 
0 - tf 
6,(t) 
0 —t 


(b) 


Fig. 5-29. (a) AC control system with potentiometers as error detector. (b) 
Typical waveforms of signals in the control system of (a). 


the signal crosses the zero-magnitude axis. This reversal in phase causes the ac 
motor to reverse in direction according to the desired sense of correction of the 
error 9,(t). The name “suppressed-carrier modulation” stems from the fact that 
when a signal @,(2) is modulated by a carrier signal v(t) according to Eq. (5-90), 
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the resultant signal e(t) no longer contains the original carrier frequency @,. To 
illustrate this, let us assume that @,(t) is also a sinusoid given by 


6(t) = sin @,(t) (5-91) 


where normally, @, < @,. By use of familiar trigonometric relations, substitut- 
ing Eqs. (5-89) and (5-91) into Eq. (5-90) we get 


e(t) = 4K,V[cos(@, — @,)t ~~ cos (@, + @,)t] (5-92) 


Therefore, e(t) no longer contains the carrier frequency q@, or the signal fre- 
quency w,, but it does have the two side bands w, + @, and w, — a,. 

Interestingly enough, when the modulated signal is transmitted through the 
system, the motor acts as a demodulator, so that the displacement of the load 
will be of the same form as the dc signal before modulation. This is clearly seen 
from the waveforms of Fig. 5-29(b). 

It should be pointed out that a control system need not contain all-de or 
all-ac components. It is quite common to couple a dc component to an ac com- 
ponent through a modulator or an ac device to a de device through a demodula- 
tor. For instance, the dc amplifier of the system in Fig. 5-28(a) may be replaced 
by an ac amplifier that is preceded by a modulator and followed by a demodula- 
tor. 


Synchros. Among the various types of sensing devices for mechanical 
shaft errors, the most widely used is a pair of synchros. Basically, a synchro is a 
rotary device that operates on the same principle as a transformer and produces 
a correlation between an angular position and a voltage or a set of voltages. 
Depending upon the manufacturers, synchros are known by such trade names 
as Selsyn, Autosyn, Diehlsyn, and Telesyn. There are many types and different 
applications of synchros, but in this section only the synchro transmitter and the 
synchro control transformer will be discussed. 


Synchro Transmitter 


A synchro transmitter has a Y-connected stator winding which resembles 
the stator of a three-phase induction motor. The rotor is a salient-pole, dumb- 
bell-shaped magnet with a single winding. The schematic diagram of a synchro 
transmitter is shown in Fig. 5-30. A single-phase ac voltage is applied to the 


Stator 
Sy S) 

Slip 

R Rotor G R, tings 
: Stator 

ac voltage A 
S3 S: 1 AY 3 Ss 1 
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Fig. 5-30. Schematic diagrams of a synchro transmitter. 


214 / Mathematical Modeling of Physical Systems Chap. 5 


rotor through two slip rings. The symbol G is often used to designate a synchro 
transmitter, which is sometimes also known as a synchro generator. 
Let the ac voltage applied to the rotor of a synchro transmitter be 


et) = E, sin a,t (5-93) 


When the rotor is in the position shown in Fig. 5-30, which is defined as the 
electric zero, the voltage induced across the stator winding between S, and the 
neutral m is maximum and is written 


€5,,At) = KE, sin ot (5-94) 
where K is a proportional constant. The voltages across the terminals S$,” and 
S3n are 

€s,(t) = KE, cos 240° sin wt = —0.5KE, sin cot (5-95) 
€5,(¢) = KE, cos 120° sin @t = —0.5KE, sin cot (5-96) 
Then the terminal voltages of the stator are 
Csi8. = Csin ~~ Com = —1.5KE, sin cot 
SiS, S Ss (5-97) 
€ 5,5; = sin — Cs = 1.5KE, sin wt 
Cs.51 = Cgsn — Csin = O (5-98) 


The above equations show that, despite the similarity between the construc- 

tion of the stator of a synchro and that of a three-phase 

S, machine, there are only single-phase voltages induced in 
the stator. 

Consider now that the rotor of the synchro trans- 
mitter is allowed to rotate in a counterclockwise direc- 
tion, as shown in Fig. 5-31. The voltages in each stator 
winding will vary as a function of the cosine of the rotor 


%» ; displacement 6; that is, the voltage magnitudes are 
53 \S Es, = KE, cos (9 — 240°) (5-99) 
Fig. 5-31. Rotor position Es,, = KE, cos @ (5-100) 
of a synchro transmitter. Es, = KE, cos (@ — 120°) (5-101) 
The magnitudes of the stator terminal voltages become 
Esis, = Egy, — Esyy = / 3 KE, sin (8 + 240°) (5-102) 
Ess, = Esin — Ein = 4/3 KE, Sin (9 + 120°) (5-103) 
Es,5, = Esin — Es = 0/3 KE, sin 0 (5-104) 


A plot of these terminal voltages as a function of the rotor shaft position is 
shown in Fig. 5-32. Notice that each rotor position corresponds to one unique 
set of stator voltages. This leads to the use of the synchro transmitter to identify 
angular positions by measuring and identifying the set of voltages at the three 
stator terminals. 
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Volts 


Rotor position 
6 (degrees) 


Fig. 5-32. Variation of the terminal voltages of a synchro transmitter as 
a function of the rotor position. @ is measured counterclockwise from 
the electric zero. 


Synchro Control Transformer 


Since the function of an error detector is to convert the difference of two 
shaft positions into an electrical signal, a single synchro transmitter is apparently 
inadequate. A typical arrangement of a synchro error detector involves the use 
of two synchros: a transmitter and a control transformer, as shown in Fig. 5-33. 


Synchro Control 
transmitter transformer 

R, Rotor Rotor R, 
Output voltage 
ac source proportional to 
sin (@, — @,) 

R, R; 

6, 6, 


Fig. 5-33. Synchro error detector. 


For small angular deviations between the two rotor positions, a proportional 
voltage is generated at the rotor terminals of the control transformer. 

Basically, the principle of operation of a synchro control transformer is 
identical to that of the synchro transmitter, except that the rotor is cylindrically 
shaped so that the air-gap flux is uniformly distributed around the rotor. This 
feature is essential for a control transformer, since its rotor terminals are usually 
connected to an amplifier or similar electrical device, in order that the latter 
sees a constant impedance. The change in the rotor impedance with rotations of 
the shaft position should be minimized. 
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The symbol CT is often used to designate a synchro control transformer. 

Referring to the arrangement shown in Fig. 5-33, the voltages given by 
Eqs. (5-102), (5-103), and (5-104) are now impressed across the corresponding 
stator terminals of the control transformer. Because of the similarity in the 
magnetic construction, the flux patterns produced in the two synchros will be 
the same if all losses are neglected. For example, if the rotor of the transmitter 
is in its electric zero position, the fluxes in the transmitter and in the control 
transformer are as shown in Fig. 5-34(a) and (b). 

When the rotor of the control transformer is in the position shown in Fig. 
5-34(b), the induced voltage at its rotor terminals is zero. The shafts of the two 
synchros are considered to be in alignment. When the rotor position of the con- 
trol transformer is rotated 180° from the position shown, its terminal voltage is 
again zero. These are known as the two null positions of the error detector. If 
the control transformer rotor is at an angle a from either of the null positions, 
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Fig. 5-34. Relations among flux patterns, rotor positions, and the rotor 
voltage of synchro error detector. 
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such as that shown in Fig. 5-34(c) and (d), the magnitude of the rotor voltage is 
proportional to sin «. Similarly, it can be shown that when the transmitter shaft 
is in any position other than that shown in Fig. 5-34(a), the flux patterns will 
shift accordingly, and the rotor voltage of the control transformer will be pro- 
portional to the sine of the difference of the rotor positions, «. The rotor voltage 
of the control transformer versus the difference in positions of the rotors of the 
transmitter and the control transformer is shown in Fig. 5-35. 


Rotor 
voltage V, 


360° a= (6, — 4) 


Fig. 5-35. Rotor voltage of control transformer as a function of the dif- 
ference of rotor positions. 


From Fig. 5-35 it is apparent that the synchro error detector is a nonlinear 
device. However, for small angular deviations of up to 15 degrees in the vicinity 
of the two null positions, the rotor voltage of the control transformer is approxi- 
mately proportional to the difference between the positions of the rotors of 
the transmitter and the control transformer. Therefore, for small deviations, 
the transfer function of the synchro error detector can be approximated by a 
constant Ks: 

E E 


Ks=9 5, = 9. 


(5-105) 


where 
£ = error voltage 
0, = shaft position of synchro transmitter, degrees 
8. = shaft position of synchro control transformer, degrees 
0, = error in shaft positions 
Ks = sensitivity of the error detector, volts per degree 


The schematic diagram of a positional control system employing a synchro 
error detector is shown in Fig. 5-36(a). The purpose of the control system is to 
make the controlled shaft follow the angular displacement of the reference input 
shaft as closely as possible. The rotor of the control transformer is mechan- 
ically connected to the controlled shaft, and the rotor of the synchro trans- 
mitter is connected to the reference input shaft. When the controlled shaft is 
aligned with the reference shaft, the error voltage is zero and the motor does not 
turn. When an angular misalignment exists, an error voltage of relative polarity 
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Fig. 5-36. (a) Alternating current control system employing synchro 
error detector. (b) Block diagram of system in (a). 


appears at the amplifier input, and the output of the amplifier will drive the 
motor in such a direction as to reduce the error. For small deviations between the 
controlled and the reference shafts, the synchro error detector can be represented 
by the constant Ks given by Eq. (5-105). Then the linear operation of the posi- 
tional control system can be represented by the block diagram of Fig. 5-36(b). 
From the characteristic of the error detector shown in Fig. 5-35, it is clear that 
Kz has opposite signs at the two null positions. However, in closed-loop systems, 
only one of the two null positions is a true null; the other one corresponds to an 
unstable operating point. 

Suppose that, in the system shown in Fig. 5-36(a), the synchro positions are 
close to the true null and the controlled shaft lags behind the reference shaft; a 
positive error voltage will cause the motor to turn in the proper direction to cor- 
rect this lag. But if the synchros are operating close to the false null, for the same 
lag between 9, and @,, the error voltage is negative and the motor is driven in 
the direction that will increase the lag. A larger lag in the controlled shaft posi- 
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tion will increase the magnitude of the error voltage still further and cause the 
motor to rotate in the same direction, until the true null position is reached. 

In reality, the error signal at the rotor terminals of the synchro control 
transformer may be represented as a function of time. If the ac signal applied to 
the rotor terminals of the transmitter is denoted by sin w,t, where w, is known 
as the carrier frequency, the error signal is given by 


e(t) = Ks6,(2) sin w,t (5-106) 


Therefore, as explained earlier, ¢(¢) is again a suppressed-carrier modulated 
signal. 


5.6 Tachometers*:> 


Fig. 5-37. Schematic diagram of a 


Tachometers are electromechanical devices that convert mechanical energy into 
electrical energy. The device works essentially as a generator with the output 
voltage proportional to the magnitude of the angular velocity. 

In control systems tachometers are used for the sensing of shaft velocity and 
for the improvement of system performance. For instance, in a control system 
with the output displacement designated as the state variable x, and the output 
velocity as the state variable x,, the first state variable may be excessed to by 
means of a potentiometer while x, is monitored by a tachometer. 

In general, tachometers may be classified into two types: ac and de. The 

simplified schematic diagrams of these two versions are 
shown in Fig. 5-37. For the ac tachometer, a sinusoidal 


< voltage of rated value is applied to the primary winding. 
A secondary winding is placed at a 90° angle mechan- 
ically with respect to the primary winding. When the 
ey 


rotor of the tachometer is stationary, the output voltage 
at the secondary winding is zero. When the rotor shaft is 
rotated, the output voltage of the tachometer is closely 
proportional to the rotor velocity. The polarity of the 
voltage is dependent upon the direction of rotation. 
The input-output relation of an ac tachometer can be 
represented by a first-order differential equation 
e(t) = K, 20 (5-107) 
dt 
where e,(t) is the output voltage, 6(z) the rotor displacement, and K, is defined as 
the tachometer constant, usually represented in units of volts per rpm or volts 
per 1000 rpm. The transfer function of an ac tachometer is obtained by taking the 
Laplace transform of Eq. (5-107); thus 
EXs) 
= K 5-108 
A dc tachometer serves exactly the same purpose as the ac tachometer 
described above. One advantage of the dc tachometer is that the magnetic field 
of the device may be set up by permanent magnet, and therefore no separate 
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excitation voltage is required. In principle, the equations of Eqs. (5-107) and 
(5-108) are also true for a dc tachometer. 

A dc tachometer can also replace an ac tachometer in a control system by 
use of a modulator to convert its de output signal into ac. Similarly, a de 
tachometer can be replaced by an ac one if a phase-sensitive demodulator is used 
to convert the ac output to de. 


5.7. DC Motors in Control Systems 


Direct current motors are one of the most widely used prime movers in industry. 
The advantages of dc motors are that they are available in a great variety of 
types and sizes and that control is relatively simple. The primary disadvantage 
of a de motor relates to its brushes and commutator. 

For general purposes, dc motors are classified as series-excited, shunt- 
excited, and separately-excited, all of which refer to the way in which the field 
is excited. However, the characteristics of the first two types of motor are highly 
nonlinear, so for control systems applications, the separately-excited de motor 
is the most popular. 

The separately-excited dc motor is divided into two groups, depending 
on whether the control action is applied to the field terminals or to the arma- 
ture terminals of the motor. These are referred to as field controlled and armature 
controlled, where usually the rotor of the motor is referred to as the armature 
(although there are exceptions). 

In recent years, advanced design and manufacturing techniques have pro- 
duced dc motors with permanent-magnet fields of high field intensity and rotors 
of very low inertia—motors with very high torque-to-inertia ratios, in other 
words. It is possible to have a 4-hp motor with a mechanical time constant as 
low as 2 milliseconds. The high torque-to-inertia ratio of dc motors has opened 
new applications for motors in computer peripheral equipment such as tape 
drives, printers, and disk packs, as well as in the machine tool industry. Of 
course, when a dc motor has a permanent-magnetic field it is necessarily arma- 
ture controlled. 

The mathematical modeling of the armature-controlled and field-controlled 
de motors, including the permanent-magnet dc motor, is discussed in the follow- 
ing. 


Field-Controlled DC Motor 


The schematic diagram of a field-controlled de motor is shown in Fig. 5-38. 
The following motor variables and parameters are defined: 


e,(t) armature voltage 

R, armature resistance 

d(t) air-gap flux 

e,(t) back emf (electromotive force) voltage 


K, back emf constant 


Sec. 5.7 


K; 
i,(t) 
i,{t) 
e;(t) 
T At) 
Jn 
Bn 
6,,(t) 
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I, = constant 


Tins 9m > Om 


Fig. 5-38. Schematic diagram of a field-controlled de motor. 


torque constant 

armature current 

field current 

field voltage 

torque developed by motor 
rotor inertia of motor 
viscous frictional coefficient 
angular rotor displacement 


To carry out a linear analysis, the following assumptions are made: 


L. 
2. 


3: 


The armature current is held constant, i, = J,. 
The air-gap flux is proportional to the field current; that is, 


H(t) = Kyi-(t) (5-109) 


The torque developed by the motor is proportional to the air-gap 
flux and the armature current. Thus 


T,,(t) a K,, 1.0) (5-110) 


where K,, is a constant. Substituting Eq. (5-109) into Eq. (5-110) 
gives 


TAlt) = Ky Ky laip(t) (5-111) 
If we let 
K, = K,, Kyl, (5-112) 
be the torque constant, Eq. (5-111) becomes 
T(t) = K,i-(t) (5-113) 


Referring to the motor circuit diagram of Fig. 5-38, the state variables are 
assigned as i,(t), w,,(¢), and 6,,(t). The first-order differential equations relating 
these state variables and the other variables are written 


1, EO = —Ryift) + et (5-114) 
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In HPD = — By crglt) + Tn) (5-115) 
d6,At) : 
ao @,,(t) (5-116) 
By proper substitution, the last three equations are written in the form of state 
equations: 

di,(t) _R; ; L 
dt pt Oe) L 

donk = f — Be 0}] a_(z)| +} 0 Je, (5-117) 
48 At) 0 1 oO, 0 


The state diagram of the system is drawn as shown in Fig. 5-39. The transfer 


ig(tot) Wm (tot) 9m (tot) 


— RglLy — Bm Im 


Fig. 5-39. State diagram of a field-controlled dc motor. 


function between the motor displacement and the input voltage is obtained from 
the state diagram as 


OCS) _ K. _ 

ES) — L,Jas* + Rye + Balj \s* + RBS (5-118) 
or 

OAS) Ky ; 

Efs) RBs + ts) + t8) (5-119) 
where 


Tn = = = mechanical time constant of motor 


m 


t= ra = field electrical time constant of motor 
f 


Armature-Controlled DC Motor 


The schematic diagram of an armature-controlled dc motor is shown in 
Fig. 5-40. In this case for linear operation it is necessary to hold the field current 
of the motor constant. The torque constant K;, relates the motor torque and the 
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~~ 6 


I; Constant field 
current 


Fig. 5-40. Schematic diagram of an armature-controlled dc motor. 


armature current, 7,(t); thus 
T,,(t) = K;i,{t) (5-120) 


where K;, is a function of the air-gap flux, which is constant in this case. Of 
course, in the case of a permanent-magnet motor, ¢ is constant also. The back 
emf voltage is proportional to the motor speed, 


est) = K, Pal) — Kyoo,(t) (5-121) 


With reference to Fig. 5-40, the state equations of the armature-controlled 
dc motor are written 


di{t) _, _K ; eo 

dt L, c, 0 i(t) L, 
do) | Ke Be : 
a |=) FL TE Off eal +] 0 je (5-122) 
dO At) 

et) 0 1 O|| 6,(t) 0 


The state diagram of the system is drawn as shown in Fig. 5-41. The transfer 
function between the motor displacement and the input voltage is obtained from 
the state diagram as 


Dns) _ K, 
EXs) i. Lin 8? ae (Rodin + B,,L,)s” + (K,K; + R,By)s 


Although a de motor is basically an open-loop system, as in the case of 
the field-controlled motor, the state diagram of Fig. 5-41 shows that the arma- 
ture-controlled motor has a “built-in” feedback loop caused by the back emf. 
Physically, the back emf voltage represents the feedback of a signal that is pro- 
portional to the negative of the speed of the motor. As seen from Eq. (5-123), 
the back emf constant, K,, represents an added term to the resistance and fric- 
tional coefficient. Therefore, the back emf effect is equivalent to an “electrical 
friction,” which tends to improve the stability of the motor. 

It should be noted that in the English unit system, K; is in lb-ft/amp or 
oz-in/amp and the back emf constant K, is in V/rad/sec. With these units, K;, 
and K, are related by a constant factor. We can write the mechanical power 


(5-123) 
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i, (to+) Wm (tot) Om (to +) 


gu 
Om 
= K,/ L, 
Fig. 5-41. State diagram of an armature-controlled de motor. 
developed in the motor armature as 
P= e,(t)i,(2) watts 
_ ex(d)i,(t) (128) 
~ "746 ap 
Substituting Eqs. (5-120) and (5-121) into Eq. (5-124), we get 
—— KT d6,,(t) ss 
P= 146K, dt Ap eal2)) 
This power is equal to the mechanical power 
_ Tm A nKt) 
P= 330 ay hp (5-126) 
Therefore, equating Eqs. (5-125) and (5-126), we have 
K, = 0.737K, (5-127) 


We can also determine the constants of the motor using torque-speed 
curves. A typical set of torque—speed curves for various applied voltages of a dc 
motor is shown in Fig. 5-42. The rated voltage is denoted by Z,. At no load, 
T,, = 0, the speed is given by the intersect on the abscissa for a given applied 
voltage. Then the back emf constant K, is given by 


Riss & (5-128) 


where in this case the rated values are used for voltage and angular velocity. 
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Tn En > E, > E,y > Ey; 


Speed w,, rad/sec 


Fig. 5-42. Typical torque-speed curves of a de motor. 


When the motor is stalled, the blocked-rotor torque at the rated voltage is 
designated by 7,(t). Let 


__ blocked-rotor torque at rated voltage _ T, 5 
‘ee rated voltage 2 ey (5-129) 
Also, 
To(t) = Kit) = HE, (5-130) 


Therefore, from the last two equations, the torque constant is determined: 


K;= kR, (5-131) 
5.8 Two-Phase Induction Motor®’ 


For low-power applications in control systems ac motors 
esi )\ are preferred over dc motors because they are more 
phase °2 () rugged and have no brushes to maintain. Most ac motors 
9m used in control systems.are of the two-phase induction 
type, which generally are rated from a fraction of a 
watt up to a few hundred watts. The frequency of the 
motor is normally at 60, 400, or 1000 Hz. 
A schematic diagram of a two-phase induction 
motor is shown in Fig. 5-43. The motor consists of a 
a) stator with two distributed windings displaced 90 elec- 
trical degrees apart. Under normal operating conditions 
in control applications, a fixed voltage from a constant- 


Fig. 5-43. Schematic diagram of a two-phase voltage source is applied to one phase, the fixed or 
induction motor. reference phase. The other phase, the control phase, is 


Reference phase 
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energized by a voltage that is 90° out of phase with respect to the voltage of 
the fixed phase. The control-phase voltage is usually supplied from a servo 
amplifier, and the voltage has a variable amplitude and polarity. The direction of 
rotation of the motor reverses when the control phase signal changes its sign. 

Unlike that of a dc motor, the torque-speed curve of a two-phase induction 
motor is quite nonlinear. However, for linear analysis, it is generally considered 
an acceptable practice to approximate the torque-speed curves of a two-phase 
induction motor by straight lines, such as those shown in Fig. 5-44. These curves 
are assumed to be straight lines parallel to the torque-speed curve at a rated 
control voltage (E, = E, = rated value), and they are equally spaced for equal 
increments of the control voltage. 


Torque 
Tin T 
° Ey > Ey > Ey > Ey > Ex 
E, = £, (rated) 
0 Ss 
0 2, 
Speed w,, 


Fig. 5-44. Typical linearized torque-speed curves of a two-phase induc- 
tion motor. 


The state equations of the motor are determined as follows. Let k be the 
blocked-rotor torque at rated voltage per unit control voltage; that is, 


__ blocked-rotor torque at E, = E, __ 7. : 
oa rated control voltage E, VE, (5-132) 


Let m be a negative number which represents the slope of the linearized torque- 
speed curve shown in Fig. 5-44. Then 


blocked-rotor torque ss Tp ts 
no-load speed ~~ Qo (67138) 


For any torque T,,, the family of straight lines in Fig. 5-44 is represented by the 
equation 
T(t) = MOn”(t) + kexlt) (5-134) 


where q,,(t) is the speed of the motor and e,(t) the control voltage. Now, if we 
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designate w,,(t) as a state variable, one of the state equations may be obtained 
from 


Ip PD — — Bytdg(t) + Ful (5-135) 


Substituting Eq. (5-134) into Eq. (5-135) and recognizing that @,,(¢) is the 
other state variable, we have the two state equations 


a) = ects) (5-136) 
dornlf) = zm — Bp )Om + Felt) (5-137) 


The state diagram of the two-phase induction motor is shown in Fig. 5-45, The 


Wm (to +) 9m (fo +) 


(m — Br )lTn 


Fig. 5-45. State diagram of the two-phase induction motor. 


transfer function of the motor between the control voltage and the motor dis- 
placement is obtained as 


6,48) k 


Ex(s)~ B, — m)s{l + Iql(By = mys] Cre 
or 

G,{S) Km 

E,(s) ~ (1 + 7,5) eee 
where 

k : 
Ky, = an motor gain constant (5-140) 
t= B Jm = motor time constant (5-141) 


Since m is a negative number, the equations above show that the effect of 
the slope of the torque-speed curve is to add more friction to the motor, thus 
improving the damping or stability of the motor. Therefore, the slope of the 
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torque-speed curve of a two-phase induction motor is analogous to the back emf 
effect of a dc motor. However, if m is a positive number, negative damping 
occurs for m > B,,, it can be shown that the motor becomes unstable. 


5.9 Step Motors®-!° 


A step motor is an electromagnetic incremental actuator that converts digital 
pulse inputs to analog output shaft motion. In a rotary step motor, the output 
shaft of the motor rotates in equal increments in response to a train of input 
pulses. When properly controlled, the output steps of a step motor are equal in 
number to the number of input pulses. Because modern control systems often 
have incremental motion of one type or another, step motors have become an 
important actuator in recent years. For instance, incremental motion control is 
found in all types of computer peripheral equipment, such as printers, tape 
drives, capstan drives, and memory-access mechanisms, as well as in a great 
variety of machine tool and process control systems. Figure 5-46 illustrates the 


Fig. 5-46. Paper-drive mechanism using a step motor. 


application of a step motor in the paper-drive mechanism of a printer. In this 
case the motor is coupled directly to the platen so that the paper is driven a 
certain increment at a time. Typical resolution of step motors available com- 
mercially ranges from several steps per revolution to as much as 800 steps per 
revolution, and even higher. 

Step motors come in a variety of types, depending upon the principle of 
operation. The two most common types of step motors are the variable-reluc- 
tance type and the permanent-magnet type. The complete mathematical analysis 
of these motors is highly complex, since the motor characteristics are very non- 
linear. Unlike de and induction motors, linearized models of a step motor are 
usually unrealistic. In this section we shall describe the principle of operation 
and a simplified mathematical model of the variable-reluctance motor. 

The variable-reluctance step motor has a wound stator and an unexcited 
rotor. The motor can be of the single- or the multiple-stack type. In the multiple- 
stack version, the stator and the rotor consist of three or more separate sets of 
teeth. The separate sets of teeth on the rotor, usually laminated, are mounted on 
the same shaft. The teeth on all portions of the rotor are perfectly aligned. 
Figure 5-47 shows a typical rotor-stator model of a motor that has three sepa- 
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| | 1/3 
Stator “C” 
| | 1/3 Rotor “C” 
Stator “B” 
> ; 3 Rotor “B” 
Stator “A” 
> f Q Rotor “A” 


Fig. 5-47. Schematic diagram of the arrangement of rotor and stator teeth 
in a multiple-stack, three-phase variable-reluctance step motor. The motor 
is shown to have 12 teeth on each stack or phase. 


rate sections on the rotor, or a three-phase motor. A variable-reluctance step 
motor must have at least three phases in order to have directional control. The 
three sets of rotor teeth are magnetically independent, and are assembled to one 
shaft, which is supported by bearings. Arranged around each rotor section is a 
stator core with windings. The windings are not shown in Fig. 5-47. Figure 5-48 
is a schematic diagram of the windings on the stator. The end view of the stator 
of one phase, and the rotor, of a practical motor is shown in Fig. 5-49. In this 
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Phase A Phase B Phase C 


Fig. 5-48. Schematic diagram of a multiple-stack three-phase variable- 
reluctance step motor. 


Fig. 5-49. End view of the stator of one phase of a multiple-stack variable- 
reluctance step motor. 
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case the rotor is shown at a position where its teeth are in alignment with that of 
the particular phase of the stator. 

The rotor and stator have the same number of teeth, which means that the 
tooth pitch on the stator and the rotor are the same. To make the motor rotate, 
the stator sections of the three-phase motor are indexed one-third of a tooth 
pitch, in the same direction. Figure 5-50 shows this arrangement for a 10-tooth 


- a_ 
a 2 
Phase C 
Phase A 


Phase B 


Fig. 5-50. Rotor and stator teeth arrangements of a multiple-stack three- 
phase variable-reluctance step motor. The rotor has 10 teeth. 


rotor. Therefore, the teeth on one stator phase are displaced 12° with respect to 
the stator phase. Here the teeth of phase C of the stator are shown to be aligned 
with the corresponding rotor teeth. The teeth of phase A of the stator are dis- 
placed clockwise by 12° with respect to the teeth of phase C. The teeth of phase 
B of the stator are displaced 12° clockwise with respect to those of phase A, or 
12° counterclockwise with respect to those of phase C. It is easy to see that a 
minimum of three phases is necessary to give directional control. In general, 
four- and five-phase motors are also common, and motors with as many as eight 
phases are available commercially. For an n-phase motor, the stator teeth are 
displaced by 1/n of a tooth pitch from section to section. 

The operating principle of the variable-reluctance stepping motor is straight- 
forward. Let any one phase of the windings be energized with a dc signal. The 
magnetomotive force setup will position the rotor such that the teeth of the 
rotor section under the excited phase are aligned opposite the teeth on the excited 
phase of the stator. This is the position of minimum reluctance, and the motor 
is in a stable equilibrium. 
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If phase C is energized in Fig. 5-50, the rotor would be (in steady state) 
positioned as shown. It can also be visualized from the same figure that if the de 
signal is switched to phase A, the rotor will rotate by 12°, clockwise, and the 
rotor teeth will be aligned opposite the teeth of phase A of the stator. Continu- 
ing in the same way, the input sequence CABCAB will rotate the motor clock- 
wise in steps of 12°. 

Reversing the input sequence will reverse the direction of rotation. That is, 
the input sequence CBACB will rotate the motor in the counterclockwise direc- 
tion in steps of 12°. 

The steady-state torque curve of each phase is approximately as shown in 
Fig. 5-51. The 0° line represents the axis of any tooth of the energized stator 
phase. The nearest rotor tooth axis will always lie within 18° on either side of 
this line. The corresponding starting torque exerted when this phase is energized 
can be seen in Fig. 5-51. The arrows mark the direction of motion of the rotor. 


Torque 


-— 18 6 


12 


Mechanical degrees 


Fig. 5-51. Torque curve for one phase of a step motor. 


Let positive angular displacements represent clockwise motion. Suppose 
also that phase C has been excited for a long time. This means that the initial 
condition of the rotor will be as shown in Fig. 5-50. If phase A is now energized 
and Fig. 5-51 represents the torque variation of phase A, the initial position of 
the rotor teeth will be at —12°. As soon as phase A is energized, the rotor will 
finally settle after some oscillations, assuming that the inertia and friction are 
such that there is no overshoot beyond the 18° point. 

It may be noticed that the position, +18°, also represents an equilibrium 
point. This is because in that position the deflecting torque is zero. It is, however, 
a position of unstable equilibrium since the slightest shift from this position will 
send the motor straight to 0°. 

If on energizing one phase the rotor happens to lie exactly at the +18° 
point, theoretically it will stay there. In practice, however, there will always be 
some mechanical imperfections in construction, and the resulting asymmetry 
will prevent any locking at the unstable point. 

We now look upon the stepping motor from a single-step point of view and 
try to develop the equations that govern its performance. Several assumptions 
will be made initially to simplify the development. Subsequent modifications 
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may be made if any of these assumptions are found to be invalidated. We start 
by writing the equation for the electrical circuit of the stator winding. Let 


e(t) = applied voltage per phase 
R = winding resistance per phase 
L(6@) = winding inductance per phase 
i(t) = current per phase 
A(t) = angular displacement 


The voltage-current equation of one stator phase is written 


et) = Ri) + FHL) 
(5-142) 
= Ri(t) + L(6) a + iZ1@) 
or 
et) = Rit) + LO) 4 +i S16) (5-143) 


The term, L(@)(di/dt) represents transformer electromotive force, or self- 
induced electromotive force, and the term i[dL(0)/d0](d0/dt) represents the 
back emf due to the rotation of the rotor. We have assumed above that the 
inductance is a function of 6(£), the angular displacement, only. No dependence 
on the current has been assumed. This will reflect directly on our procedure for 
getting the torque developed by the motor. 

The energy in the air gap can be written 


W = 4L(6)?2(2) (5-144) 


From elementary electromechanical energy-conversion principles, we know 
that the torque in a single excited rotational system is given by 


T= SW 6)] (5-145) 


where W is the energy of the system expressed explicitly in terms of i(t) and 
6(t). Therefore, 


T= +i) SILO) (5-146) 


This torque is then applied to the rotor and the equation of motion is 

obtained as 
_ 7 d*6(t) dit) 
T= Im apa + Bn (5-147) 

where J,, is the rotor inertia and B,, the viscous frictional coefficient. J,, and B,, 
also may include the effects of any load. 

To complete the torque expression of Eq. (5-146), we need to know the 
form of the inductance Z(@). In practice the motor inductance as a function of 
displacement may be approximated by a cosine wave; that is, 


L(@) = L, + L, cos r6 (5-148) 
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where L, and L, are constants and r is the number of teeth on each rotor section. 
Substituting Eq. (5-148) into Eq. (5-146), we get 

T = —4L,ri7(t) sin r8 = — Ki2(1) sin ré (5-149) 

which is the sinusoidal approximation of the static torque curve of Fig. 5-51. 

Now let us apply these equations to a three-phase motor. Let the equilib- 


rium position be the situation when phase A is energized. Then the inductance 
and torque for phase A are given by 


L,=L, +L, 008 10 (5-150) 
T, = —kKi sin rd (5-151) 
€4 — &ba 
32 
en 1 ly 4 A T 1 6 1 @ 
(| aaa, CY COR OOF] ati 3 
CO-— 
a0 
€p — eng 
if 7, 
OO] tig PO Ge 
7 Rp + sLp + 
_ + 
sR sin (106 — 120°) 


€\c — &oc : 
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Fig. 5-52. Block diagram of the variable-reluctance step motor. 
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respectively. For the 10-teeth rotor considered earlier, r = 10, phase B has its 
equilibrium position 12° behind the reference point, assuming that the sequence 
ABC represents forward motion. Similarly, the equilibrium position of phase C 
is 12° ahead of the reference point. Therefore, the inductances and the torques 
for phases B and C are written as follows: 


Ly = Ly + L, cos (109 — 120°) (5-152) 
Le = Ly + L, cos (109 + 120°) (5-153) 
T, = —Kii(t) sin (100 — 120°) (5-154) 
Te. = —Ki2(¢) sin (100 + 120°) (5-155) 


The electrical circuits of the three phases are isolated so that each phase has its 
differential equation of the form of Eq. (5-143). 

The total torque developed on the rotor is the algebraic sum of torques 
of the three phases. Thus 


T=T,+TstTe (5-156) 


The nonlinearity of the torque equations precludes the use of linearized models 
for the portrayal of a step motor. Therefore, realistic studies of a step motor 
using the equations presented above can be made only through computer simula- 
tion. A block-diagram representation of the motor, which may be used for 
analog or digital computer simulation, is shown in Fig. 5-52. 


5.10 Tension-Control System 


The problem of proper tension control exists in a great variety of winding and 
unwinding industrial processes. Such industries as paper, plastic, and wire all 
have processes that involve unwinding and rewinding processes. For example, 
in the paper industry, the paper is first wound on a roll in a form that is nonsale- 
able, owing to nonuniform width and breaks. This roll is rewound to trim edges, 
splice breaks, and slit to required widths. Proper tension during this rewinding 
is mandatory for several reasons: slick paper will telescope if not wound tightly 
enough and the width will vary inversely as the tension. Conversely, during 
storage, a roll wound at varying tensions has internal stresses that will cause it 
to explode. Similar examples could be cited, but the need for proper tension 
control is relatively simple to understand. 

Most rewind systems contain an unwind roll, a windup roll driven by a 
motor, and some type of dancer and/or pinch-roller assemblies between the two. 
Some systems employ spring-with-damper idlers with feedback to motor drives 
to control tension. Some use tension-measuring devices and feedback to a 
motor-generator or brake on the unwind reel to hold tension at a constant 
value. 

In this section a specific type of tension-control system for unwind processes 
is investigated. As shown in Fig. 5-53, the system has a dc-motor-driven windup 
reel. The tension of the web is controlled by control of the armature voltage e,(f) 
of the motor. 
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Fig. 5-53. Tension-control system for a winding process. 


The mathematical modeling of the system is conducted by writing the 
equations of the de motor. 


Armature: 
—_ , di,{t) 
eo{t) = Rai(t) + La + Ks@nlt) (5-157) 


where 


K, = back emf constant of motor 
o,,(t) = angular velocity of motor 


Torque equation: 


T(t) = SlImeOm(O)] + BueOom(t) + 0 T(t) (5-158) 


where 


r == effective radius of windup reel 
T,,(t) = motor torque = K;,i,(¢) 
n = gear-train ratio 
T(t) = web tension 
Jme = Im + wJ, = equivalent inertia at motor shaft 
Bue = B, + n’*B, = equivalent viscous friction coefficient 
at motor shaft 
J, = effective inertia of windup reel 
B, = viscous friction coefficient of windup reel 


Since the web material is taken up by the windup reel as the process pro- 
ceeds, the inertia J, and the radius r of the windup reel increase as functions of 
time. This explains the reason the derivative of J,.@m is taken in Eq. (5-158). 
Furthermore, if 4 denotes the thickness of the web, 


dr_h : 
Fy Ow (5-159) 
In= er (5-160) 
Thus 
aS, _ au pps : 
7 ew 2npr ai (5-161) 
where 


p = mass density of the web material per width 
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Assume now that the web material has a coefficient of elasticity of C and 
that Hooke’s law is obeyed. Then 


ao = Clo,() — 0] (5-162) 


where »,(¢) is the web velocity at the pinch rolls. Assuming that the pinch rolls 
are driven at constant speed, v,(t) = constant = V,. Also, 


v,(t) = ro,(t) = nre,,(t) (5-163) 


It is apparent now that because r and J, are functions of time, Eq. (5-158) 
is a time-varying nonlinear differential equation. However, if the web is very 
thin, h ~ 0, we may consider that over a certain time period r and J, are con- 
stant. Then, the linearized state ee of the system are written 


aA) _ _ Rey £1) — Pon! +7 Le at) (5-164) 
dol __ S a Lid) — Ene 7 Gg(t) _ 770 (5-165) 
aT = Cnr@,,(t) — CV, (5-166) 


5.11 Edge-Guide Control System 


Whenever there is a tension-control problem there is a desire for edge-guide con- 
trol. Therefore, the problem of edge guiding has become very important in 
modern paper manufacturing, steel strip processing lines, flexographic and 
textile industries, and similar fields. To maintain optimum sheet quality and 
maximum process line speed, the moving web must be maintained at a constant 
lateral-edge position. In general, there are many different ways of measuring and 
tracking the edge of a moving web. However, to achieve stable and accurate 
edge guiding, a feedback control system should be used. 

The schematic diagram of an edge-guide system using the pivot-roll method 
is shown in Fig. 5-54. The pivot roll is controlled to rotate about the pivot 
point in guiding the direction of the web. The source of controlling the motion 
of the pivot roll may be a dc motor coupled to a lead screw or rack and pinion, 
or a linear actuator. 

Figure 5-55 shows the side view of the edge-guide system. The axes of the 
rollers 1 and 2 are assumed to be fixed or uncontrolled. S; and S, represent 
sensors that are placed at the indicated points to sense the centering of the web 
at the respective points. 

Let 

v(t) = linear velocity of web 
z,(t) = initial error of web position in the z direction at roll | 
z,(t) = error of web position in the z direction at the leading 
side of the pivot roll (see Figs. 5-54 and 5-55) 


; { 
To 
control 


Fig. 5-55. Side view of an edge-guide system. 
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Assuming that there is no slippage when the web moves over the pivot roll, 
the following equation is written for v(t) and z,(f): 


a9 — v(t) tan o (5-167) 
If the angle & is small, from Fig. 5-54 it is seen that 
tan op ~~ Za) — 21) (5-168) 
m, 


Thus Eq. (5-167) can be written approximately as 
a2) = (2 — ae (5-169) 
If the linear velocity of the web is constant, v(t) = v, and Eq. (5-169) is 


written 
dz s (t) 


+2) = mH) (5-170) 


Taking the Laplace ae a on both sides of Eq. (5-170), the transfer 
relation between z,(t) and z,(t) is 


Zs) sk 


Zs = es (5-171) 
where t, = m,/v. 
Assuming that there is no stretching in the web, from Fig. 5-55, 
Z(t) — z1@) = Z(t) — 2,(2) (5-172) 
mM, mM, 
or 
20) = 21) + lee) — 2:0] (5-173) 


Taking the Laplace transform on both sides of Eq. (5-173) and solving for 
Z,(s), we have 


1+ 5 
ZA) = 7m, eee (5-174) 


Substitution of Z,(s) from Eq. (174) into Eq. (171) gives the transfer rela- 
tion between Z,(s) and Z,(s), 
Zi(s) _ 1 
Z,(s) 1 + (m,/m,)t,8 
When the pivot roll is rotated by an angle 6, from its reference position, the 
error Z,(t) will be affected by approximately D sin @,(t). With no slippage of the 
web over the pivot roll, the error z(t) due to the error z,(f) is written 
2,(t) = z,(t — T) — DO,(t) (5-176) 
where T = 2D/2v, and for small 6,(2), sin 8,(t) is approximated by 0,(#). Take 
the inverse Laplace transform on both sides of Eq. (5-176) which yields 
Z,(s) = e-™Z,(s) — DO,(s) (5-177) 


Similar to the relationship between z, and z,, the transfer function between 


(5-175) 
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z,(t) and z,(t) is 
Zs(s)___1 : 
Zs) 1+ 38 6-178) 
where t; = m;,/v. Also, in analogy to Eq. (5-174), the transfer relation between 
Zz; and Z, is 
Z,(s) _ 1+ (m,4/m3)t35 se 
Z3(s) + 735 one) 
Now consider that the drive motor of the system is an armature-controlled 
de motor with negligible inductance. The equation of the motor armature is 


I,{$) = Eds) — sKobals) (5-180) 


where J,(s) is the armature current, K, the back emf constant, R, the armature 
resistance, and @,,(s) the motor displacement. The torque is given by 


T,A(s) = K,1,(s) (5-181) 


where K;, is the torque constant. 
The torque equation of the motor and load is 


TCS) = (JSn5? + By 5)8,(5) + LF(s) (5-182) 
where 
J, = inertia of motor 
B,, = viscous frictional coefficient of motor 
L = lead of screw 
F(s) = transform of force in the x direction 
and 
F(s) = we (Ius* + Bys + K,)6,(s) (5-183) 
where 


J, = inertia of pivot roll about pivot point 
B, = viscous frictional coefficient at pivot point 
K,, = spring constant at pivot roll due to tension of web 


Combining Eqs. (5-182) and (5-183), we have 


60S) 1 : 
T (3) ~ Tnd™ + Baad t Raw Sieh) 
where 
2 
Ine = In + (5) Iu (5-185) 
/ 2 
Bue = By + (55) B, (5-186) 
2 
| =) K; (5-187) 
Also, 
X(s) = rO,(s) (5-188) 
81(5) = 5 Ons) (5-189) 


A block diagram of the overall system is drawn as shown in Fig. 5-56 using 
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Eqs. (5-175), (5-177), (5-179), (5-180), (5-181), (5-184), and (5-189). The blocks 
with transfer functions H,(s) and H,(s) represent possible locations of control- 
lers of the edge-guide system. The design problem may involve the determination 
of the transfer functions H,(s) and H,(s), so that for a given error z, the error 
Z; iS minimized. 


5.12 Systems with Transportation Lags 


Thus far a great majority of the systems considered have transfer functions that 
are quotients of polynomials. However, in the edge-guide control system of 
Section 5.11, the relation between the variables z,(t) and z,(t) is that of a pure 
time delay. Then Z,(s) and Z,(s) are related through an exponential transfer 
function e-7*. In general, pure time delays may be encountered in various types 
of systems, especially systems with hydraulic, pneumatic, or mechanical trans- 
missions. In these systems the output will not begin to respond to an input until 
after a given time interval. Figure 5-57 illustrates examples in which transporta- 


Metering aeeewee 
point 14 Solution A 


Solution B 


Thickness 


measuring gauge 


y J Roller (2)) 


v~=~— —~<— Steel plate 


| Roller (8) 
> 


be d 


(b) 


Fig. 5-57. Physical systems with transportation lags. 


tion lags are observed. Figure 5-57(a) outlines an arrangement in which two 

different fluids are to be mixed in appropriate proportions. To assure that a 

homogeneous solution is measured, the monitoring point is located some dis- 

tance from the mixing point. A transportation lag therefore exists between the 

mixing point and the place where the change in concentration is detected. If 

the rate of flow of the mixed solution is v inches per second and dis the distance 
between the mixing and the metering points, the time lag is given by 

T= 4 sec (5-190) 

If it is assumed that the concentration at the mixing point is c(t) and that it 

is reproduced without change T seconds later at the monitoring point, the 
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measured quantity is 


b(t) = c(t — T) (5-191) 
The Laplace transform of the last equation is 
B(s) = eT C(s) (5-192) 
Thus the transfer function between b(t) and c(#) is 
Bis) _ e-r 5-193 
Cs) =e ( ) 


The arrangement shown in Fig. 5-57(b) may be thought of as a thickness 
control of the rolling of steel plates. As in the case above, the transfer function 
between the thickness at the rollers and the measuring point is given by Eq. 
(5-193). 

Other examples of transportation lags are found in human beings as control 
systems where action and reaction are always accompanied by pure time delays. 
The operation of the sample-and-hold device of a sampled-data system closely 
resembles a pure time delay; it is sometimes approximated by a simple time-lag 
term, e™. 

In terms of state variables, a system with pure time delay can no longer be 
described by the matrix-state equation 


aut) = Ax() + Bu() (5-194) 


A general state description of a system containing time lags is given by the fol- 
lowing matrix differential-difference equation: 
a) _ ¥ axe — 7) + YBa — 7) (5-195) 
iF j=l 
where T, and T, are fixed time delays. In this case Eq. (5-195) represents a 


general situation where time delays may exist on both the inputs as well as the 
states. 


5.13 Sun-Seeker System 


In this section we shall model a sun-seeker control system whose purpose is to 
control the attitude of a space vehicle so that it will track the sun with high ac- 
curacy. In the system described, tracking of the sun in one plane is accomplished. 
A schematic diagram of the system is shown in Fig. 5-58. The principal elements 
of the error discriminator are two small rectangular silicon photovoltaic cells 
mounted behind a rectangular slit in an enclosure. The cells are mounted in 
such a way that when the sensor is pointed at the sun, the beam of light from the 
slit overlaps both cells. The silicon cells are used as current sources and con- 
nected in opposite polarity to the input of an operational amplifier. Any differ- 
ence in the short-circuit current of the two cells is sensed and amplified by the 
operational amplifier. Since the current of each cell is proportional to the illu- 
mination on the cell, an error signal will be present at the output of the amplifier 
when the light from the slit is not precisely centered on the cells. This error 


244 / Mathematical Modeling of Physical Systems Chap. 5 


Error discriminator 


1/n Solar axis 


—a 
. = I ~Vehicle 
q axis 


Sun ray 


de motor 


Servo 


amplifier fle,( mu g 
~ K, 


amplifier 


dc tachometer 


Fig. 5-58. Schematic diagram of a sun-seeker system. 


voltage, when fed to the servoamplifier, will cause the servo to drive the system 
back into alignment. A description of each part of the system is given as follows. 


Coordinate System 


The center of the coordinate system is considered to be at the output gear 
of the system. The reference axis is taken to be the fixed frame of the de motor, 
and all rotations are measured with respect to this axis. The solar axis or the line 
from the output gear to the sun makes an angle 6, with respect to the reference 
axis, and @, denotes the vehicle axis with respect to the reference axis. The objec- 
tive of the control system is to maintain the error between @, and @,, a, near 
Zero: 

a = 0, — Oy (5-196) 


Figure 5-59 shows the coordinate system described. 


Error Discriminator 


When the vehicle is aligned perfectly with the sun, «7 = 0, and J, = I, = J, 
or I, — I, = 0. From the geometry of the sun’s rays and the photovoltaic cells 
shown in Fig. 5-58, we have 


oa = uA 4. Ltana (5-197) 
ob = W — Ltana, (5-198) 
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Solar 
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Vehicle 
axis 


Center of ; 
output gear Fixed axis of 
dc motor frame 


Fig. 5-59. Coordinate system of the sun-seeker system. 


where oa denotes the width of the sun’s ray that shines on cell A, and ob is the 
same on cell B, for a given a. Since the current J, is proportional to oa, and J, 
to ob, we have 


ees: " 
,=1+ 47 tana (5-199) 
and 
2LI 
=I WT tan a (5-200) 


for 0< tana <W/2L. For W/2L < tana <(C — W/2)/L, the sun’s ray is com- 
pletely on cell A, and J, = 2/, I, = 0. For (C — W/2)/E < tana < (C+ W/2)/L, 
I, decreases linearly from 27 to zero. J, = J, = 0 for tana > (C+ W/2)/L. 
Therefore, the error discriminator may be represented by the nonlinear charac- 
teristic of Fig. 5-60, where for small angle a, tan « has been approximated by a 
on the abscissa. 


Fig. 5-60. Nonlinear characteristic of the error discriminator. The abscissa 
is tan @ but is approximated by a for small values of «. 
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Operational Amplifier 


The schematic diagram of the operational amplifier is shown in Fig. 5-61. 
Summing the currents at point G and assuming that the amplifier does not draw 
any current, we have 


_ _ @ Co — Cg a 
I,—1,— + BE = 0 (5-201) 


Fig. 5-61. Operational amplifier. 


Since ¢g = —Ae,, eg = —€/A, Eq. (5-201) becomes 
1 1 1 =o : 
L—hh+(qe+etage=9 (5-202) 


If A approaches infinity, as in operational amplifiers, 4 may reach 10°; then 
Eq. (5-202) is written 5 
@o = —RAI, — 1) (5-203) 


This equation gives the transfer relationship between J, — J, and ey. 


Servoamplifier 
The gain of the servoamplifier is —K,. With reference to Fig. 5-58, the 
output of the servo amplifier is expressed as 
a= —K,(eo + er) 


5-204 
aaare: K, e, ( ) 


Tachometer 


The output voltage of the tachometer e, is related to the angular velocity of 
the motor through the tachometer constant K;; that is, 


er = Kr (5-205) 


The angular position of the output gear is related to the motor position through 
the gear ratio 1/n. Thus 


630. (5-206) 
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Armature-Controlled DC Motor 


The armature-controlled de motor has been modeled earlier. The equations 


are 
ae een (5-207) 
e&= Ki@m (5-208) 
T, = Kyl, (5-209) 
ies jin + Bom (5-210) 


where J and B are the inertia and viscous friction coefficient seen at the motor 
shaft. The inductance in the motor armature is neglected in Eq. (5-207). 

A block diagram that characterizes all the functional relations of the system 
is shown in Fig. 5-62. 
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PROBLEMS 


5.1. Write the force or torque equations for the mechanical systems shown in Fig. 
P5-1. Write the state equations from the force or torque equations. 


F(t) 


F(t) 


(c) 


Figure P5-1. 


5.2. Write a set of state equations for the mechanical system shown in Fig. P5-2. 


On the first try, one will probably end up with four state equations with the 
state variables defined as 82, @2, 8,, and @,. However, it is apparent that there 


are only three energy-storage elements in J;, K, and J2, so the system has a 
minimum order of three. 


Figure P5-2, 
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5.3. 


(a) Write the state equations in vector-matrix form with the state variables 
defined as above. 

(b) Redefine the state variables so that there are only three state equations. 

(c) Draw state diagrams for both cases. 

(d) Derive the transfer function @.2(s)/T(s) for each case, and cornpare the 
results. 

(e) Determine the controllability of the system. Does the fact that the system 
can be modeled by three state equations mean that the four-state model is 
uncontrollable? Explain. 


For the system shown in Fig. P5-3, determine the transfer function Eo(s)/T;,(s). 
The potentiometer rotates through 10 turns, and the voltage applied across the 
potentiometer terminals is E volts. 


5.4. 


Potentiometer 


B, = viscous friction coefficient of 
potentiometer contact 


Figure P5-3. 


Write the torque equations of the gear-train system shown in Fig. P5-4. The 
moments of inertia of the gears and shafts are J;, J2, and J3. T(t) is the applied 
torque. N denotes the number of gear teeth. Assume rigid shafts. 


T(t) 


Jy 


N» 


Na 


Figure P5-4, 
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5.5. Figure P5-5 shows the diagram of an epicyclic gear train. 


Figure P5-5. 


(a) Using the reference directions of the angular velocity variables as indicated, 
write algebraic equations that relate these variables. 
(b) Draw a signal flow graph to relate among the inputs @, and @, and the 
output @¢. 
(c) Find the transfer function relation between @. and @, and @,. 
5.6. The block diagram of the automatic braking control of a high-speed train is 
shown in Fig. P5-6a, where 


Tachometer 


(a) 


f(t) 
100 Ibs 


100 (1 — e-16r) 


0 0.1 (Sec) 
(b) 


Figure P5-6. 
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5.7. 


V, = voltage representing desired speed 
» = velocity of train 
K = amplifier gain = 100 
M = mass of train = 5 x 10¢ Ib/ft/sec? 
K, = tachometer constant = 0.15 volt/ft/sec 
e, = K,v 


The force characteristics of the brake are shown in Fig. P5-6b when e, = 1 volt. 

(Neglect all frictional forces.) 

(a) Draw a block diagram of the system and include the transfer function of 
each block. 

(b) Determine the closed-loop transfer function between V, and velocity v of 
the train. 

(c) If the steady-state velocity of the train is to be maintained at 20 ft/sec, 
what should be the value of V,? 


Figure P5-7 illustrates a winding process of newsprint. The system parameters 
and variables are defined as follows: 


Figure P5-7. 


€, = applied voltage 
R = armature resistance of dc motor 
L = armature inductance of dc motor 
i, = armature current 
K, = back emf of dc motor 
Tm = motor torque = K,,i, 
Jm == motor inertia 
Br, = motor friction coefficient 
J, = inertia of windup reel 
@,, = angular velocity of dc motor 
@ = angular velocity of windup reel 
T, = torque at the windup reel 
r = effective radius of windup reel 
» = linear velocity of web at windup reel 
T = tension 
’; = linear velocity of web at input pinch rolls 


Assume that the linear velocity at the input pinch rolls, V’,, is constant. The 
elasticity of the web material is assumed to satisfy Hooke’s law; that is, the dis- 
tortion of the material is directly proportional to the force applied, and the 
proportional constant is K (force/displacement). 
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(a) Write the nonlinear state equations for the system using i,, @,,, and T as 


state variables. 


(b) Assuming that r is constant, draw a state diagram of the system with e, and 


V, as inputs. 


5.8. Write state equations and output equation for the edge-guide control system 


whose block diagram is shown in Fig. 5-56. 
5.9. The schematic diagram of a steel rolling process is shown in Fig. PS-9. 


Two-phase 
induction motor 


9mm (t), Tin (1) 


Gear box and 
linear actuator 


c(t) a(t) <~——-v 


| F d al plate 


b(t) = Ksc(t) 
a(t) = n6,, (t) 


Figure P5-9. 


(a) Describe the system by a set of differential-difference equation of the form 


of Eq. (5-195). 
(b) Derive the transfer function between c(t) and r(t). 


5.10. Figure P5-10a shows an industrial process in which a dc motor drives a capstan 
and tape assembly. The objective is to drive the tape at a certain constant speed. 


Another tape driven by a separate source is made to be in contact with the 


primary tape by the action of a pinch roll over certain periods of time. When the 
two tapes are in contact, we may consider that a constant frictional torque of 


Ty is seen at the load. The following system parameters are defined: 


e, = applied motor voltage, volts 
i, = armature current, amperes 
e, = back emf voltage = K,@,,, volts 
K, = back emf constant = 0.052 volt/rad/sec 
K, = torque constant = 10 oz-in./amp 
i Tm = torque, oz-in. 
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J, Load 
K, . ) ja ap 

——> Ty 
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Pinch 
H 
(a) TO 
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Integral 
control 


1 volt/rad/s 


Feedback transducer 


(b) 


Figure P5-10. 


6,, = motor displacement, rad 
@mn = motor speed, rad/sec 

R, = motor resistance = 1Q 

Jim = motor inertia = 0.1 oz-in./rad/sec? (includes capstan inertia) 

Bn = motor viscous friction = 0.1 oz-in./rad/sec 

K, = spring constant of tape = 100 oz-in./rad (converted to rotational) 
J, = load inertia = 0.1 oz-in./rad/sec? 


(a) Write the equations of the system in vector-matrix state equation form. 

(b) Draw a state diagram for the system. 

(c) Derive the transfer function for @,(s) with E,(s) and 7;(s) as inputs. 

(d) If a constant voltage e,(#) = 10 V is applied to the motor, find the steady- 
state speed of the motor. in rpm when the pinch roll is not activated. What 
is the steady-state speed of the load? 

(e) When the pinch roll is activated, making the two tapes in contact, the 
constant friction torque Ty is 1 oz-in. Find the change in the steady-state 
speed c, when e, = 10 V. 

(f) To overcome the effect of the frictional torque 7; it is suggested that a 
closed-loop system should be formed as shown by the block diagram in 
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Fig. PS-10(b). In this case the motor speed is fed back and compared with 
the reference input. The closed-loop system should give accurate speed 
control, and the integral control should give better regulation to the fric- 
tional torque. Draw a state diagram for the closed-loop system. 
(g) Determine the steady-state speed of the load when the input is 1 V. First 
consider that the pinch roll is not activated, and then is activated. 
This problem deals with the attitude control of a guided missile. When traveling 
through the atmosphere, a missile encounters aerodynamic forces that usually 
tend to cause instability in the attitude of the missile. The basic concern from the 
flight control standpoint is the lateral force of the air, which tends to rotate the 
missile about its center of gravity. If the missile centerline is not aligned with 
the direction in which the center of gravity C is traveling, as shown in Fig. P5-11 


Figure P5-11. 


with the angle @ (@ is also called the angle of attack), a side force is produced by 
the resistance of the air through which the missile is traveling. The total force 
F,, may be considered to be centered at the center of pressure P. As shown in 
Fig. P5-11, this side force has a tendency to cause the missile to tumble, espe- 
cially if the point P is in front of the center of gravity C. Let the angular accelera- 
tion of the missile about the point C, due to the side force, be denoted by &,. 
Normally, @, is directly proportional to the angle of attack @ and is given by 


Op = ad 
where a is a constant described by 
a = Keds 


Ky is a constant that depends on such parameters as dynamic pressure, velocity 
of the missile, air density, and so on, and 


J = missile moment of inertia about C 
d; = distance between C and P 


The main object of the flight control system is to provide the stabilizing action 
to counter the effect of the side force. One of the standard control means is to 


256 / Mathematical Modeling of Physical Systems Chap. 5 


5.12. 


5.13. 


5.14. 


use gas injection at the tail of the missile to deflect the direction of the rocket 

engine thrust 7, as shown in Fig. P5-11. 

(a) Write a torque differential equation to relate among T, 6, 8, and the system 
parameters. Assume that 6 is very small. 

(b) Assume that 7 is constant and find the transfer function 6(s)/6(s) for small 
é. 

(c) Repeat (a) and (b) with the points C and P interchanged. 

(a) Draw a state diagram for the tension-control system of Fig. 5-53, using the 
state equations of Eqs. (5-164), (5-165), and (5-166). 

(b) Write the relation among E£,(s), V,, and T(s), with E,(s) and V, as inputs and 
T(s) as the output. 

The following equations describe the motion of an electric train in a traction 

system: 


X(t) = v(t) 


ot) = —k(v) — eg) + TU) 
where 


x(t) = linear displacement of train 
v(t) = linear velocity of train 
k(v) = train resistance force [odd function of v, with the properties 
k(O) = 0 and dk(v)/dv > 0] 
g(x) = force due to gravity for a nonlevel track or due to curvature of track 
T(t) = tractive force 


The electric motor that provides the traction force is described by the following 
relations: 
e(t) = Ky P(t)v(t) + Ri(t) 
T(t) = Kn P(t) in(t) 
where 
R = armature resistance 
o(t) = magnetic flux = K; i;(r) 
e(t) = applied voltage 
K,,, Ky = proportional constants 
i,(t) = armature current 
ip(t) = field current 


(a) Consider that the motor is a dc series motor so that i,(t) = i(t); g(x) = 0, 
k(v) = Bo(t), and R = 0. The voltage e(t) is the input. Show that the system 
is described by the following set of nonlinear state equations: 


X(t) = v(t) 
Wt) = —Bolt) + EER AGE 


(b) Consider that i,(t) = i,(¢) is the input and derive the state equations of the 
system. g(x) = 0, k(v) = Bo(t). 

(c) Consider that @(¢) is the input, g(x) = 0, A(v) = Be(*), and derive the state 
equations of the system. 

Figure P5-14 shows a gear-coupled mechanical system. 

(a) Find the optimum gear ratio n such that the load acceleration, %,, is 
maximized. 

(b) Repeat part (a) when the load drag torque 7, is zero. 
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T(t) 


Figure P5-14. 


(a) Write the torque equations of the system in Fig. P5-15 in the form 
@ + J-'K® =0 
where @ is a 3 x 1 vector that contains all the displacement variables, 6,, 


6,, and 03. J is the inertia matrix and K contains all the spring constants. 
Determine J and K. 


Figure P5-15. 


(b) Show that the torque equations can be expressed as a set of state equations 
of the form 
x = Ax 


[ 0 | 
1d pee = 
—J-1K'0 


(c) Consider the following set of parameters with consistent units: K 1 = 1000, 
K, = 3000, J; = 1, Jz = 5, J; = 2, and K; = 1000. Find the matrix A. 
Figure P5-16 shows the layout of the contro! of the unwind process of a cable 
reel with the object of maintaining constant linear cable velocity. Control is 
established by measuring the cable velocity, comparing it with a reference 
signal, and using the error to generate a control signal. A tachometer is used to 
sense the cable velocity. To maintain a constant linear cable velocity, the 
angular reel velocity @g must increase as the cable unwinds; that is, as the 

effective radius of the reel decreases. Let 


D = cable diameter = 0.1 ft 
W = width of reel = 2 ft 
Ro = effective radius of reel (empty reel) = 2 ft 


where 
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Amplifier 


Figure P5-16. 


R; = effective radius of reel (full reel) = 4 ft 
R = effective radius of reel 
Jz = moment of inertia of reel = 18R4 — 200 ft-lb-sec? 
vp = linear speed of cable, ft/sec 
é,; = output voltage of tachometer, volts 
T,,(t) = motor torque, ft-lb 
e,,(¢) = motor input voltage, volts 
K = amplifier gain 


Motor inertia and friction are negligible. The tachometer transfer function is 


Ej(s) _ J 
VAs) 14+ 0.5s 


and the motor transfer function is 


T(s) 50 
E,(s) S+1 

(a) Write an expression to describe the change of the radius of the reel Ras a 
function of Oz. 

(b) Between layers of the cable, R and Jz are assumed to be constant, and the 
system is considered linear. Draw a block diagram for the system and indi- 
cate all the transfer functions. The input is e, and the output is vz. 

(c) Derive the closed-loop transfer function Vp(s)/E,(s). 


6 


Time-Domain Analysis 


6.1 


of Control Systems 


Introduction 


Since time is used as an independent variable in most control systems, it is usu- 
ally of interest to evaluate the time response of the systems. In the analysis 
problem, a reference input signal is applied to a system, and the performance of 
the system is evaluated by studying the response in the time domain. For 
instance, if the objective of the control system is to have the output variable 
follow the input signal as closely as possible, it is necessary to compare the input 
and the output as functions of time. 

The time response of a control system is usually divided, into two parts: 
the transient response and the steady-state response. If c(t) denotes a time 
response, then, in general, it may be written 


c(t) = c(t) + ¢,.(0) (6-1) 
where 
c(t) = transient response 


c,,(t) = steady-state response 


The definition of the steady state has not been entirely standardized. In circuit 
analysis it is sometimes useful to define a steady-state variable as being a constant 
with respect to time. In control systems applications, however, when a response 
has reached its steady state it can still vary with time. In control systems the 
steady-state response is simply the fixed response when time reaches infinity. 
Therefore, a sine wave is considered as a steady-state response because its behav- 
ior is fixed for any time interval, as when time approaches infinity. Similarly, if 
a response is described by c(t) = 1, it may be defined as a steady-state response. 


259 


260 / Time-Domain Analysis of Control Systems Chap. 6 


Transient response is defined as the part of the response that goes to zero 
as time becomes large. Therefore, c,() has the property of 
lim c(t) = 0 (6-2) 
ie 
It can also be stated that the steady-state response is that part of the response 
which remains after the transient has died out. 

All control systems exhibit transient phenomenon to some extent before a 
steady state is reached. Since inertia, mass, and inductance cannot be avoided 
in physical systems, the responses cannot follow sudden changes in the input 
instantaneously, and transients are usually observed. 

The transient response of a control system is of importance, since it is part 
of the dynamic behavior of the system; and the deviation between the response 
and the input or the desired response, before the steady state is reached, must 
be closely watched. The steady-state response, when compared with the input, 
gives an indication of the final accuracy of the system. If the steady-state 
response of the output does not agree with the steady state of the input exactly, 
the system is said to have a steady-state error. 


6.2 Typical Test Signals for Time Response of Control Systems 


Unlike many electrical circuits and communication systems, the input excitations 
to many practical control systems are not known ahead of time. In many cases, 
the actual inputs of a control system may vary in random fashions with respect 
to time. For instance, in a radar tracking system, the position and speed of the 
target to be tracked may vary in an unpredictable manner, so that they cannot 
be expressed deterministically by a mathematical expression. This poses a prob- 
lem for the designer, since it is difficult to design the control system so that it 
will perform satisfactorily to any input signal. For the purposes of analysis and 
design, it is necessary to assume some basic types of input functions so that the 
performance of a system can be evaluated with respect to these test signals. By 
selecting these basic test signals properly, not only the mathematical treatment 
of the problem is systematized, but the responses due to these inputs allow the 
prediction of the system’s performance to other more complex inputs. In a 
design problem, performance criteria may be specified with respect to these test 
signals so that a system may be designed to meet the criteria. 

When the response of a linear time-invariant system is analyzed in the fre- 
quency domain, a sinusoidal input with variable frequency is used. When the 
input frequency is swept from zero to beyond the significant range of the system 
characteristics, curves in terms of the amplitude ratio and phase between input 
and output are drawn as functions of frequency. It is possible to predict the 
time-domain behavior of the system from its frequency-domain characteristics. 

To facilitate the time-domain analysis, the following deterministic test 
signals are often used. 


Step input function. The step input function represents an instantaneous 
change in the reference input variable. For example, if the input is the angular 
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position of a mechanical shaft, the step input represents the sudden rotation of 
the shaft. The mathematical representation of a step function is 


R t>0 


6-3) 
0 +t<0 ¢ 


rt) = 

where R is a constant. Or 
r(t) = Ru,{t) (6-4) 
where u,(¢) is the unit step function. The step function is not defined at ¢ = 0. 


The step function as a function of time is shown in Fig. 6-1(a). 


(t) r(t) Slope =R 


t t 


(a) (b) 


r(t) 


(c) 
Fig. 6-1. Basic time-domain test signals for control systems. (a) Step 


function input, r(t) = Rus(t). (b) Ramp function input, r(t) = Rtus(t). 
(c) Parabolic function input, r(t) = Rr2u;(t). 


Ramp input function. In the case of the ramp function, the signal is con- 
sidered to have a constant change in value with respect to time. Mathematically, 
a ramp function is represented by 


R >0 
we <0 2 
or simply 
r(t) == Rtu,(t) (6-6) 


The ramp function is shown in Fig. 6-1(b). If the input variable is of the form of 
the angular displacement of a shaft, the ramp input represents the constant- 
speed rotation of the shaft. 


Parabolic input function. The mathematical representation of a parabolic 
input function is 


2 0 
ofr es en 
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or simply 
r(t) = Rt*u,(t) (6-8) 


The graphical representation of the parabolic function is shown in Fig. 6-1(c). 

These test signals all have the common feature that they are simple to de- 
scribe mathematically, and from the step function to the parabolic function they 
become progressively faster with respect to time. The step function is very useful 
as a test signal since its initial instantaneous jump in amplitude reveals a great 
deal about a system’s quickness to respond. Also, since the step function has, in 
principle, a wide band of frequencies in its spectrum, as a result of the jump dis- 
continuity, as a test signal it is equivalent to the application of numerous 
sinusoidal signals with a wide range of frequencies. 

The ramp function has the ability to test how the system would respond to 
a signal that changes linearly with time. A parabolic function is one degree faster 
than a ramp function. In practice, we seldom find it necessary to use a test signal 
faster than a parabolic function. This is because, as we shall show later, to track 
or follow a high-order input, the system is necessarily of high order, which may 
mean that stability problems will be encountered. 


6.3 Time-Domain Performance of Control Systems— 
Steady-State Response 


In this section we shall discuss the typical criteria used for the measurement of 
the time-domain performance of a control system. The time response of a control 
system may be characterized by the transient response and the steady-state 
response or, as an alternative, by a performance index that gives a qualitative 
measure on the time response as a whole. These criteria will be discussed in the 
following. 


Steady-State Error 


It was mentioned earlier that the steady-state error is a measure of system 
accuracy when a specific type of input is applied to a contro! system. In a phy- 
sical system, because of friction and the nature of the particular system, the 
steady state of the output response seldom agrees exactly with the reference 
input. Therefore, steady-state errors in control systems are almost unavoidable, 
and in a design problem one of the objectives is to keep the error to a minimum 
or below a certain tolerable value. For instance, in a positional control system, 
it is desirable to have the final position of the output be in exact correspondence 
with the reference position. In a velocity-control system, the objective is to have 
the output velocity be as close as possible to the reference value. 

If the reference input r(t) and the controlled output c(t) are dimensionally 
the same, for example, a voltage controlling a voltage, a position controlling a 
position, and so on, and are at the same level or of the same order of magnitude, 
the error signal is simply 


e(t) = r(t) — c(t) (6-9) 
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However, sometimes it may be impossible or inconvenient to provide a 
reference input that is at the same level or even of the same dimension as the 
controlled variable. For instance, it may be necessary to use a low-voltage 
source for the control of the output of a high-voltage power source; for a 
velocity-control system it is more practical to use a voltage source or position 
input to control the velocity of the output shaft. Under these conditions, the 
error signal cannot be defined simply as the difference between the reference 
input and the controlled output, and Eq. (6-9) becomes meaningless. The input 
and the output signals must be of the same dimension and at the same level 
before subtraction. Therefore, a nonunity element, H(s), is usually incorporated 
in the feedback path, as shown in Fig. 6-2. The error of this nonunity-feedback 


c(t) 


C(s) 
Fig. 6-2. Nonunity feedback control system. 
control system is defined as 
e(t) = r(t) — 5) (6-10) 
or 
&(s) = R(s) — B(s) = R(s) — H(s)C(s) (6-11) 


For example, if a 10-v reference is used to regulate a 100-v voltage supply, 1 
is a constant and is equal to 0.1. When the output voltage is exactly 100 v, the 
error signal is 

e(t) = 10 — 0.1-100 = 0 (6-12) 


As another example let us consider that the system shown in Fig. 6-2 is a 
velocity-control system in that the input r(r) is used as a reference to control the 
output velocity of the system. Let c(t) denote the output displacement. Then, 
we need a device such as a tachometer in the feedback path, so that H(s) = K;,s. 
Thus the error in velocity is defined as 


e(t) = r(t) — b(t) 
ye pee) (6-13) 
r(t) K, dt 
The error becomes zero when the output velocity dc(t)/dt is equal to r(t)/K,. 
The steady-state error of a feedback control system is defined as the error 
when time reaches infinity; that is, 


steady-state error = e,, = lim e(t) (6-14) 
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With reference to Fig. 6-2, the Laplace-transformed error function is 


R(s) 
1 + G(s)H(s) 


By use of the final-value theorem, the steady-state error of the system is 
é,, = lim e(t) = lim s8(s) (6-16) 
fro 570 


8(s) = (6-15) 


where s&(s) is to have no poles that lie on the imaginary axis and in the right half 
of the s-plane. Substituting Eq. (6-15) into Eq. (6-16), we have 
jj sR(s) 
Ces = IM T—"G@AG) 

which shows that the steady-state error depends on the reference input R(s) 
and the loop transfer function G(s)H(s). 

Let us first establish the type of control system by referring to the form of 
G(s)A(s). In general, G(s)H(s) may be written 


_KO+ 7,5) 4+ T,s)...(1 + T,,5) 

CNA) = SET) + Ts) ET) rte) 
where K and all the Ts are constants. The type of feedback control system refers 
to the order of the pole of G(s)H(s) at s = 0. Therefore, the system that is de- 
scribed by the G(s)H(s) of Eq. (6-18) is of type 7, where j = 0, 1,2,.... The values 
of m,n, and the Ts are not important to the system type and do not affect the 
value of the steady-state error. For instance, a feedback contro] system with 


Kd. + 0.5s) 
si -+ s)\(1 + 2s) 


(6-17) 


G(s)H(s) = 


(6-19) 


is of type 1, since 7 = 1. 
Now let us consider the effects of the types of inputs on the steady-state 
error. We shall consider only the step, ramp, and parabolic inputs. 


Steady-state error due to a step input. If the reference input to the control 
system of Fig. 6-2 is a step input of magnitude R, the Laplace transform of the 
input is R/s. Equation (6-17) becomes 


eC) ee | a : 
en EGA) tT C@HG) ~Taime@nG 
s>0 
For convenience we define 
K, = lim G(s)A(s) (6-21) 
so 
where K, is the positional error constant. Then Eq. (6-20) is written 
R 

Css = I am K, (6-22) 


We see that for e,, to be zero, when the input is a step function, K, must be 
infinite. If G(s)H(s) is described by Eq. (6-18), we see that for K, to be infinite, 
j must be at least equal to unity; that is, G(s)H(s) must have at least one pure 
integration. Therefore, we can summarize the steady-state error due to a step 
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input as follows: 


type 0 system: €..= == constant 


I 
type | (or higher) system: e,, = 0 


Steady-state error due to a ramp input. \f the input to the control system 
of Fig. 6-2 is 
r(t) = Rtu,(t) (6-23) 


where R is a constant, the Laplace transform of r(t) is 
R(s) = z (6-24) 


Substituting Eq. (6-24) into Eq. (6-17), we have 
R 


= R aes oe is 
en GGG) = lms) 6:25) 
s70 
If we define 
K, = lim sG(s)H(s) = velocity error constant (6-26) 
s>0 
Eq. (6-25) reads 
R 
é.= K (6-27) 


which is the steady-state error when the input is a ramp function. A typical e,, 
due to a ramp input is shown in Fig. 6-3. 


c(t) 


Reference input “DP Css = R/Ky 
r(t) = Rtu,(t) 


Output c(t) 


0 


Fig. 6-3. Typical steady-state error due to a ramp input. 


Equation (6-27) shows that for e,, to be zero when the input is a ramp 
function, K, must be infinite. Using Eq. (6-18) and (6-26), 


f= G1, 2.054 (6-28) 


j-1 


K, = lim sG(s)H(s) = lim * 
s-0 s-o S 


Therefore, in order for K, to be infinite, ; must be at least equal to two, or the 
system must be of type 2 or higher. The following conclusions may be stated 
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with regard to the steady-state error of a system with ramp input: 


type 0 system: e., =o 
type 1 system: C5, = ae constant 
kK, 


type 2 (or higher) system: e,, = 0 


Steady-state error due to a parabolic input. If the input is described by 


r) = Eu) (6-29) 
the Laplace transform of r(t) is 
R(s) = 4 (6-30) 


The steady-state error of the system of Fig. 6-2 is 
R 


° ~ Tim FO QA) vee 
5-0 
Defining the acceleration error constant as 
K, = lim s?G(s)H(s) (6-32) 
s-0 
the steady-state error is 
eu =% (6-33) 


The following conclusions can be made with regard to the steady-state error of 
a system with parabolic input: 


type 0 system: €,, = 00 
type 1 system: Cs, = 8 
type 2 system: Q.= z = constant 


type 3 (or higher) system: e,, = 0 


As a summary of the error analysis, the relations among the error constants, 
the types of the system, and the input types are tabulated in Table 6-1. The 
transfer function of Eq. (6-18) is used as a reference. 


Table 6-1 Summary of the Steady-State Errors Due to Step, Ramp, 
and Parabolic Inputs 


—— 


Step Ramp Parabolic 

Type of Input, Input, Input, 
System eg = e. = esa 
j Ky Ky Kz 3s 1+ Kp ss K, 3s Ka 

0 K 0 0 n= ers = 00 ess = 90 

ss T + K ss ss 

1 fo) K 0 ess = 0 ess z ss = 0 

2 os) co) K €ss = 0 ess = 0 en=f 

ed co oo ess = 90 ess = Css = 9 
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It should be noted that the position, velocity, and acceleration error con- 
stants are significant in the error analysis only when the input signal is a step 
function, a ramp function, and a parabolic function, respectively. 

It should be noted further that the steady-state error analysis in this section 
is conducted by applying the final-value theorem to the error function, which is 
defined as the difference between the actual output and the desired output signal. 
In certain cases the error signal may be defined as the difference between the 
output and the reference input, whether or not the feedback element is unity. 
For instance, one may define the error signal for the system of Fig. 6-2 as 


e(f) = r(t) — c(t) (6-34) 
Then 
As) =*4 a TR) (6-35) 
and 


_ am lL + G(S)[H(s) — 1] 
amma cg | GHG 


It should be kept in mind that since the steady-state error analysis discussed 
here relies on the use of the final-value theorem, it is important to first check to 
see if sE(s) has any poles on the jq axis or in the right half of the s-plane. 

One of the disadvantages of the error constants is, of course, that they do 
not give information on the steady-state error when inputs are other than the 
three basic types mentioned. Another difficulty is that when the steady-state 
error is a function of time, the error constants give only an answer of infinity, 
and do not provide any information on how the error varies with time. We shall 
present the error series in the following section, which gives a more general repre- 
sentation of the steady-state error. 


R(s) (6-36) 


Error Series 


In this section, the error-constant concept is generalized to include inputs 
of almost any arbitrary function of time. We start with the transformed error 
function of Eq. (6-15), 

R(s) 


9) = TE Gs)H@ 


(6-37) 


or of Eq. (6-35), as the case may be. 
Using the principle of the convolution integral as discussed in Section 3.3, 
the error signal e(¢) may be written 


e@) = f_w.ltrt — 2) det (6-38) 
where w,(t) is the inverse Laplace transform of 


W (5) = (6-39) 


1 
I + G(s)H(s) 


which is known as the error transfer function. 
Tf the first 7 derivatives of r(t) exist for all values of t, the function r(t — 1) 
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can be expanded into a Taylor series; that is, 
2 3 
r(t—t) =r) — tH) + FO = HO aes (6-40) 


where F(t) represents the first derivative of r(t) with respect to time. 

Since r(f) is considered to be zero for negative time, the limit of the con- 
volution integral of Eq. (6-38) may be taken from 0 to ¢, Substituting Eq. (6-40) 
into Eq. (6-38), we have 


e() = J wala)| rO — td) + a = THO +... ‘| dt 
rae (6-41) 
= r(t) | w(t) dt — F(t) tw,(t) dt + F(t) | Fwe(a) dt 4.33 


As before, the steady-state error is obtained by taking the limit of e(r) as t 
approaches infinity; thus 
e,, = lim e(4) = lim €,(4) (6-42) 
fo f-00 


where ¢€,(t) denotes the steady-state part of €(¢) and is given by 


€,(t) = r,(t) | : w(t) dt — F,(t) ie tw,(t) dt + F,(t) if Fw.) at 


(6-43) 
3 
— F(t) [ Hiv et) ae ee 
and r,(t) denotes the steady-state part of r(z). 
Let us define 
Cy = f w(t) dt 
0 
Cc, = -{" tw(t) dt 
0 
—f{ 7 
C, ( t?w(t) at (6-44) 
Cc, = (-l)) iB tw (t) at 
Equation (6-42) is written 
e,(t) = Cort) + Cyr.) + Sr.) Bs he Sarin) +... (645) 
which is called the error series, and the coefficients, Cy, C;,C,,...,C, are 


defined as the generalized error coefficients, or simply as the error coefficients. 

The error coefficients may be readily evaluated directly from the error 
transfer function, W,(s). Since W,(s) and w,(t) are related through the Laplace 
transform, we have 


Ws) = J, w(t)e- dt (6-46) 
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Taking the limit on both sides of Eq. (6-46) as s approaches zero, we have 


lim W,(s) = lim {- w (tie dt 
s70 tt) 


3-70 (6-47) 
——— Cp 
The derivative of W.(s) of Eq. (6-46) with respect to s gives 
dWAs)_ _ a ae 
7 : tw(t)e* dt (6-48) 
== Cie 
from which we get 
C, = lim FES) (6-49) 
soo ds 


The rest of the error coefficients are obtained in a similar fashion by taking suc- 
cessive differentiation of Eq. (6-46) with respect to s. Therefore, 


PW (5) 


C. = tin 0 
C; = lim oP) (6-51) 
C, = lim eras (6-52) 


The following examples illustrate the general application of the error series 
and its advantages over the error constants. 


EXAMPLE 6-1 _In this illustrative example the steady-state error of a feedback control 
system will be evaluated by use of the error series and the error coef- 
ficients. Consider a unity feedback control system with the open-loop 

transfer function given as 


G(s) = (6-53) 


_K_ 
st+l1 
Since the system is of type 0, the error constants are K, = K, K, = 0, and K, = 0. 
Thus the steady-state errors of the system due to the three basic types of inputs are as 
follows: 


unit step input, u,(t): ess = > 


unit ramp input, tu,(1): C55 = 0 
unit parabolic input, t2u,(t): e,;, = co 


Notice that when the input is either a ramp or a parabolic function, the steady- 
state error is infinite in magnitude, since it apparently increases with time. It is apparent 
that the error constants fail to indicate the exact manner in which the steady-state 
function increases with time. Therefore, ordinarily, if the steady-state response of this 
system due to a ramp or parabolic input is desired, the differential equation of the sys- 
tem must be solved. We now show that the steady-state response of the system can 
actually be determined from the error series. 
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Using Eq. (6-39), we have for this system 
1 s+ 


WG) =TF 6m ~F+KTI (6-54) 
The error coefficients are evaluated as 
Co = lim Ws) = ra (6-55) 
C= 1 TE” = OER or 
C= tn 2 (6-57) 


sso ds? (1 + KY? 


Although higher-order coefficients can be obtained, they will become less significant 
as their values will be increasingly smaller. The error series is written 


_ 4 Ks, —K ,,. 
e,(t) = TK RIO + a+ Ky Ky + a+K Ky) +... (6-58) 
Now let us consider the three basic types of inputs. 


1. When the input signal is a unit step function, r,(‘) == «,(¢), and all deriva- 
tives of r,(t) are zero. The error series gives 


1 
e,(t) = THK (6-59) 
which agrees with the result given by the error-constant method. 
2. When the input signal is a unit ramp function, r,(t) =: tu,(¢), 7.(t) = u(t), 
and all higher-order derivatives of 7,(t) are zero. Therefore, the error series 
is 


es) = [et + ae] (6-60) 


which indicates that the steady-state error increases linearly with time. 
The error-constant method simply yields the result that the steady-state 
error is infinite but fails to give details of the time dependence. 

3. For a parabolic input, r,(¢) = (t?/2)u,(t), 7,(t) = tu.(2), F(t) = u(t), and 
all higher derivatives are zero. The error series becomes 

1 7 K K 
es(t) [; + K2 + él + au Ts (i + ad u(t) (6-61) 

In this case the error increases in magnitude as the second power of t. 

4. Consider that the input signal is represented by a polynomial of ¢ and an 
exponential term, 


y= [ao ig ge as f em lus) (6-62) 
where ao, @;, 42, and a3 are constants. Then, 
2 

rt) = [ay +ayt+ oo |ustt) (6-63) 

FAt) = (a, + art)u,(t) (6-64) 

¥(t) = azu,(t) (6-65) 


In this case the error series becomes 


6) = ERO + GP ERRO-— TO (6-66) 
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EXAMPLE 6-2 In this example we shall consider a situation in which the error con- 
stant is totally inadequate in providing a solution to the steady-state 
error. Let us consider that the input to the system described in Example 

6-1 is a sinusoid, 

r(t) = sin Mot (6-67) 
where @) = 2. Then 
r,t) = sin Mot 


Ft) = Wo COS Wot 


(6-68) 
¥(t) = —@} sin Wot 
F(t) = —W3 cos Wot 
The error series can be written 
et) = [Co S003 + C+ cos Se | sin Wot + [ Crm. — Goi +.. ‘| COS Wot 
(6-69) 


Because of the sinusoidal input, the error series is now an infinite series. The con- 
vergence of the series is important in arriving at a meaningful answer to the steady- 
state error. It is clear that the convergence of the error series depends on the value of 
@, and K. Let us assign the value of K to be 100. Then 


Co = hoy ca 0.0099 
K 
C1 = ada Ky 0.0098 
2K 
C, (+ Kp 0.000194 
6K = 
C; = + Ky 269 x 1078 
Thus, using only the first four error coefficients, Eq. (6-69) becomes 
0.000194 ; 
s(t) <= | 0.0099 + ——~— -4 |sin 2¢ + 0.0196 cos 2t 
e,(t) k + 3 | i + c (6-10) 
= 0.01029 sin 2r + 0.0196 cos 2t 
or 
e,(t) ~ 0.02215 sin (2t + 62.3°) (6-71) 


Therefore, the steady-state error in this case is also a sinusoid, as given by Eq. (6-71). 


6.4 Time-Domain Performance of Contro! Systems— 
Transient Response 


The transient portion of the time response is that part which goes to zero as 
time becomes large. Of course, the transient response has significance only when 
a stable system is referred to, since for an unstable system the response does not 
diminish and is out of control. 
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The transient performance of a control system is usually characterized by 
the use of a unit step input. Typical performance criteria that are used to charac- 
terize the transient response to a unit step input include overshoot, delay time, 
rise time, and settling time. Figure 6-4 illustrates a typical unit step response of 


c(t) 
Maximum 
overshoot 


Unit step input 


Steady-state 
error 
(t > 0) 
—yF, —___—__» { 
. : : t max 
Rise time 
Settling >| 
time 


Fig. 6-4. Typical unit step response of a control system. 


a linear control system. The above-mentioned criteria are defined with respect to 
the step response: 


1. Maximum overshoot. The maximum overshoot. is defined as the 
largest deviation of the output over the step input during the tran- 
sient state. The amount of maximum overshoot? is also used as a 
measure of the relative stability of the system. The maximum over- 
shoot is often represented as a percentage of the final value of the 
step response; that is, 


: maximum overshoot 

per cent maximum overshoot = = Paal@alue. 100% 

(6-72) 

2. Delay time. The delay time 7, is defined as the time required for the 
step response to reach 50 per cent of its final vaiue. 

3. Rise time. The rise time 7, is defined as the time required for the 

step response to rise from 10 per cent to 90 per cent of its final value. 


Sometimes an alternative measure is to represent the rise time as a 
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reciprocal of the slope of the step response at the instant that the 
_ Tesponse is equal to 50 per cent of its final value. 
4. Settling time. The settling time 7, is defined as the time required for 
the step response to decrease and stay within a specified percentage 
of its final value. A frequently used figure is 5 per cent. 


The four quantities defined above give a direct measure of the transient 
characteristics of the step response. These quantities are relatively easy to mea- 
sure when a step response is already plotted. However, analytically these quan- 
tities are difficult to determine except for the simple cases. 


Performance Index 


Since the general design objective of a control system is to have a small 
overshoot, fast rise time, short delay time, short settling time, and low steady- 
State error, it is advantageous to use a performance index that gives a measure 
of the overall quality of the response. Let us define the input signal of a system 
as r(t) and the output as c(t). The difference between the input and the output 
is defined as the error signal, as in Eq. (6-9). Sometimes r(r) is referred to as 
the desired output. 

In trying to minimize the error signal, time integrals of functions of the error 
signal may be used as performance indices. For example, the simplest integral 
function of the error is 


f= f : e(t) dt (6-73) 


where J is used to designate performance index. It is easy to see that Eq. (6-73) 
is not a practical performance index, since minimizing it is equivalent to mini- 
mizing the area under e(t), and an oscillatory signal would yield a zero area and 
thus a zero J. Some of the practical integral performance indices are 


f ‘ |e(t)| dt i te(t) dt { : e?(t) dt 


and there are many others. The subject of the design of control systems using 
performance indices is covered in Chapter 11. 


6.5 Transient Response of a Second-Order System 


Although true second-order control systems are rare in practice, their analysis 
generally helps to form a basis for the understanding of design and analysis 
techniques. 

Consider that a second-order feedback control system is represented by the 
state diagram of Fig. 6-5. The state equations are written 


(a I x,(t) 0 : : 
eA 7 les es BA % | 1 | © (6-74) 


where ¢ and q, are constants. 
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x7(0 +)/s x, (0 +)/s 


Fig. 6-5. State diagram of a second-order feedback control system. 


The output equation is 
c(t) = @nxs(t) (6-75) 
Applying the gain formula to the state diagram of Fig. 6-5, the state transi- 
tion equations are written 


[ X,(s) Pas s+ 2Co, 1 x,(0+) 1 1 : 
ee 7 x —w? ql eal ‘2 | . |R@) (6-76) 


where 
A = s? + 2C@,5 + w? (6-77) 
The inverse Laplace transform of Eq. (6-76) is carried out with the help of 
the Laplace transform table. For a unit step function input, we have 


| evsent | Sin (opr/1 — Crt yw) = sin w,/1 -— Ct i eel 


x,(t) Wier =O, SiN Op/T— Ct sin (eor/T — Ct + $) |L.x2(04). 
=; {I + sae Fe merc om a (678) 
t>0 
oe sin @,./1 — Ct | 
where 


Although Eq. (6-78) gives the complete solution of the state variables in 
terms of the initial states and the unit step input, it is a rather formidable-looking 
expression, especially in view of the fact that the system is only of the second 
order. However, the analysis of control systems does not rely completely on the 
evaluation of the complete state and output responses. The development of 
linear control theory allows the study of control system performance by use of 
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the transfer function and the characteristic equation. We shall show that a great 
deal can be learned about the system’s behavior by studying the location of the 
roots of the characteristic equation. 

The closed-loop transfer function of the system is determined from Fig. 6-5. 


C(s)_ On 6-81 

Re) ~ + Kos + oF on 
The characteristic equation of the system is obtained by setting Eq. (6-77) to 
zero; that is, 


A = s? + 2fa,5 + w@2 =0 (6-82) 
For a unit step function input, R(s) = I/s, the output response of the system 
is determined by taking the inverse Laplace transform of 


C(s) = (6-83) 


Os 
s(s? + 20c,5 + an) 
Or, c(t) is determined by use of Eqs. (6-75) and pias with zero initial states: 


ce) = 1 + —— were a sin] oT — ¢*¢ —tan- wi’ t>0 (6-84) 


It is interesting to oon the relationship between a roots of the characteristic 
equation and the behavior of the step response c(t). The two roots of Eq. (6-82) 
are 
51,5, = —Co, + ja,/1 aoe 
= —-a+tjo 

The physical significance of the constants f, w,, a, and @ is now described 
as follows: 

As seen from Eq. (6-85), « = Cw,, and « appears as the constant that is 
multiplied to ¢ in the exponential term of Eq. (6-84). Therefore, « controls the 
rate of rise and decay of the time response. In other words, a controls the 
“damping” of the system and is called the damping constant or the damping 
factor. The inverse of a, 1/a, is proportional to the time constant of the system. 

When the two roots of the characteristic equation are real and identical we 
call the system critically damped. From Eq. (6-85) we see that critical damping 
occurs when € = 1. Under this condition the damping factor is simply a = a,,. 
Therefore, we can regard ¢ as the damping ratio, which is the ratio between the 
actual damping factor and the damping factor when the damping is critical. 

@, is defined as the natural undamped frequency. As seen from Eq. (6-85), 
when the damping is zero, € = 0, the roots of the characteristic equation are 
imaginary, and Eq. (6-84) shows that the step response is purely sinusoidal. 
Therefore, @, corresponds to the frequency of the undamped sinusoid. 

Equation (6-85) shows that 


= Wyr/l — C? (6-86) 
However, since unless € = 0, the response of Eq. (6-84) is not a periodic func- 
tion. Therefore, strictly, @ is not a frequency. For the purpose of reference q@ is 
sometimes defined as conditional frequency. 


(6-85) 
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Fig. 6-6. Relationship between the characteristic equation roots of a 
second-order system and @, {, w,, and o. 


Figure 6-6 illustrates the relationship between the location of the charac- 
teristic equation roots and a, €, w,, and @. For the complex-conjugate roots 
shown, q,, is the radial distance from the roots to the origin of the s-plane. The 
damping factor « is the real part of the roots; the conditional frequency is the 
imaginary part of the roots, and the damping ratio ¢ is equal to the cosine of 
the angle between the radial line to the roots and the negative real axis; that is, 


¢ = cos 6 (6-87) 


Figure 6-7 shows the constant-@, loci, the constant-€ loci, the constant-« 
loci, and the constant-@ loci. Note that the left-half of the s-plane corre- 
sponds to positive damping (i.e., the damping factor or ratio is positive), and the 
right-half of the s-plane corresponds to negative damping. The imaginary axis 
corresponds to zero damping (a = 0, ¢ = 0). As shown by Eq. (6-84), when 
the damping is positive, the step response will settle to its constant final value 
because of the negative exponent of e**. Negative damping will correspond 
to a response that grows without bound, and zero damping gives rise to a sus- 
tained sinusoidal oscillation. These last two cases are defined as unstable for 
linear systems. Therefore, we have demonstrated that the location of the charac- 
teristic equation roots plays a great part in the dynamic behavior of the transient 
response of the system. 

The effect of the characteristic-equation roots on the damping of the second- 
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Fig. 6-7. (a) Constant natural undamped frequency loci. (b) Constant 
damping ratio loci. (c) Constant damping factor loci. (d) Constant condi- 
tional frequency loci. 


order system is further illustrated by Figs. 6-8 and 6-9. In Fig. 6-8, w, is held 
constant while the damping ratio ¢ is varied from —oo to +00. The following 
classification of the system dynamics with respect to the value of € is given: 


0O<€< 1: 51,5, = —Gm, + jo,/1 — ¢* underdamped case 


C=1: Si, 5, = —@, critically damped case 
C>1: $1, 8, = —Ca, + w,/6% — 1 overdamped case 
C¢=0: Si, 5S, = jo, undamped case 


€¢<0: $1, 8, = —Co, + jo,/1 — €? negatively damped case 


Fig. 6-8. Locus of roots of Eq. (6-82) when oz, is held constant while the 
damping ratio is varied from — oo to +o. 
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Fig. 6-9 (Cont.). 


Figure 6-9 illustrates typical step responses that correspond to the various root 
locations, 

In practical applications only stable systems are of interest. Therefore, 
the cases when ¢ is positive are of particular interest. In Fig. 6-10 is plotted the 
variation of the unit step response described by Eq. (6-84) as a function of the 
normalized time @,t, for various values of the damping ratio ¢. It is seen that 
the response becomes more oscillatory as € decreases in value. When €>1 
there is no overshoot in the step response; that is, the output never exceeds the 
value of the reference input. 

The exact relation between the damping ratio and the amount of overshoot 
can be obtained by taking the derivative of Eq. (6-84) and setting the result to 
zero. Thus 


CD) = SO anlar 29) 
dt oe (6-88) 
e Ont 


Fai On /1 — F cos (wt — 6) t>0 


TAL 
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c(t) 


Fig. 6-10. Transient response of a second-order system to a unit step func- 


tion input. 
where 
6 =tanivt Te (6-89) 
Equation (6-88) is simplified to 
ao es oon sino, /I1—Ct 1>0 (6-90) 


Therefore, setting Eq. (6-90) to zero, we have tf = oo and 


Op/l—-Ct=nn n=0,1,2,... (6-91) 
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or 


t= Iv era (6-92) 


The first maximum value of the step response c(t) occurs at n = |. Therefore, 
the time at which the maximum overshoot occurs is given by 


tmax = ata (6-93) 


In general, for all odd values of n, that is, n = 1, 3,5,..., Eq. (6-92) gives 
the times at which the overshoots occur. For all even values of n, Eq. (6-92) 
gives the times at which the undershoots occur, as shown in Fig. 6-11. It is 
interesting to note that, although the maxima and the minima of the response 
occur at periodic intervals, the response is a damped sinusoid and is not a 
periodic function. 


c(t) 


Max. 
overshoot 


2a 3n 4n Wyt 


vI-F VI-® Vvi-® Vink 


Fig. 6-11. Step response illustrating that the maxima and minima occur at 
periodic intervals. 


The magnitudes of the overshoots and the undershoots can be obtained by 
substituting Eq. (6-92) into Eq. (6-84). Thus 


-ant/VT-E /{ — f2 
CCE) Imax ot min — I + Sa sin (na — tan~! vi—t) na= 1, 2, Perea 


Ie = 
(6-94) 
or 
CCE) Imax or min == 1 + (1 te etVTHE (6-95) 
The maximum overshoot is obtained by letting n = 1 in Eq, (6-95). Therefore, 
maximum overshoot = c,,, — | = eV (6-96) 
and 


per cent maximum overshoot = 100e-7*/”1-@ (6-97) 
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Fig. 6-12. Per cent overshoot as a function of damping ratio for the step 
response of a second-order system. 


Note that for the second-order system, the maximum overshoot of the step 
response is only a function of the damping ratio. The relationship between the 
per cent maximum overshoot and damping ratio for the second-order system 
is shown in Fig. 6-12. 

From Eqs. (6-93) and (6-94) it is seen that for the second-order system under 
consideration, the maximum overshoot and the time at which it occurs are all 
exactly expressed in terms of { and w,. For the delay time, rise time, and settling 
time, however, the relationships are not so simple. It would be difficult to deter- 
mine the exact expressions for these quantities. For instance, for the delay time, 
we would have to set c(t) = 0.5in Eq. (6-84) and solve for ¢. An easier way 
would be to plot @,t,; versus € as shown in Fig. 6-13. Then, over the range of 
0< ¢ < 1.0 it is possible to approximate the curve by a straight line, 


@ntg ~ 1 + 0.76 (6-98) 
Thus the delay time is 
ty ae (6-99) 


For a wider range of €, a second-order equation should be used. Then 


ty 1 + 0.6¢ + 0.15? (6-100) 
On 
For the rise time ¢,, which is the time for the step response to reach from 
10 per cent to 90 per cent of its final value, the exact values can again be obtained 
directly from the responses of Fig. 6-10. The plot of w,/, versus € is shown in 
Fig. 6-14. In this case the rise time versus € relation can again be approximated 
by a straight line over a limited range of €. Therefore, 


1, OB F258 Qe r<l (6-101) 


n 


A better approximation may be obtained by using a second-order equation; 


Gy tq 
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Fig. 6-13. Normalized delay time versus € for a second-order control 
system. 
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Fig. 6-14. Normalized rise time versus ¢ for a second-order system. 


then 
2 
tp Lt Ll + 140? (6-102) 
On 
From the definition of settling time, it is clear that the expression for the 
settling time is the most difficult to determine. However, we can obtain an approx- 
imation for the case of O< ¢ < | by using the envelope of the damped sinu- 
soid, as shown in Fig. 6-15. 
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Fig. 6-15. Approximation of settling time using the envelope of the decay- 
ing step response of a second-order system (0 < { < 1). 


From the figure it is clear that the same result is obtained with the approx- 
imation whether the upper envelope or the lower envelope is used. Therefore, 


—lonts 

=1+4+ 4 =105 6-103 
(O=1+— a=! (6-103) 

Solving for w,¢, from the last equation, we have 
anes = In [0.05,/T = C3] (6-104) 

For small values of ¢, Eq. (6-104) is simplified to 
Ont, = + (6-105) 

or 
ome, 2 

t=, 0<f<1 (6-106) 


Now reviewing the relationships for the delay time, rise time, and settling 
time, it is seen that small values of £ would yield short rise time and short delay 
time. However, a fast settling time requires a large value for ¢. Therefore, a 
compromise in the value of ¢ should be made when ail these criteria are to be 
satisfactorily met in a design problem. Together with the consideration on 
maximum overshoot, a generally accepted range of damping ratio for satis- 
factory all-around performance is between 0.5 and 0.8. 


6.6 Time Response of a Positional Control System 


In this section we shall study the time-domain performance of a control system 
whose objective is to control the position of a load that has viscous friction and 
inertia. The schematic diagram of the system is shown in Fig. 6-16. 
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Fig. 6-16. Direct current positional control system. 


A set of potentiometers form the error detector with Sensitivity K,. The 
error detector sends a signal to the dc amplifier which is proportional to the 
difference between the angular positions of the reference input shaft and the 
output shaft. The output of the dc amplifier is used to control the armature of 
a de motor. The current in the field of the de motor is held constant. 

The parameters of the system are given as follows: 


Sensitivity of error detector K, = 1/57.3 volt/deg = 1 volt/rad 
Gain of de amplifier A (variable) 

Resistance of armature of motor R,=5Q 

Inductance of armature of motor L, = negligible 


Inertia of rotor of motor Jn = 1073 lb-ft-sec2 
Friction of motor shaft B,, = negligible 
Friction of load shaft B, = 0.1 Ib-ft-sec 
Inertia of load J, = 0.1 Ib-ft-sec? 
Gear ratio n=N,/N, = qy 
Torque constant of motor K, = 0.5 1b-ft/amp 


The first step in the analysis is to write the equations for the system. This 
is done by proceeding from the input to the output following through the cause- 
and-effect relationship. 


1. Error detector: 
9.(t) = Ot) — 8,(1) (6-107) 
e(t) = K,0,(t) (6-108) 
2. DC amplifier: 
e,(t) = Ae(t) (6-109) 
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3. Armature-controlled dc motor: 
LAD — — Rit) + edt) — est 


e,(t) = K,a,,(t) 


where K, is the back emf constant of the motor: 


T At) = K,i{t) 


In felD = — ByeOn(t) ++ T,,(t) 


Chap. 6 


(6-110) 


(6-111) 


(6-112) 
(6-113) 


where J,,, and B,,, are the equivalent inertia and viscous frictional 


coefficients seen by the motor, respectively, and 


Ime = Im + nS, = 10-3 + 0.01(00.1) = 2 x 10°? Ib-ft-sec? 


Bne = By, + n*B, = 1073 Ib-ft-sec 
4. Output: 
Bul — oo,(0) 


An = n6,,(t) 


(6-114) 
(6-115) 


(6-116) 
(6-117) 


The value of the back emf constant, K,, is not given originally, but a definite 
relationship exists between K, and K;. In the British unit system, K; is given in 
lb-ft/amp and the units of the back emf constant are volts/rad/sec. With these 
units, K, is related to K, through a constant ratio. The mechanical power 


developed in the motor armature is (see Sec, 5.7) 


P(t) = e, (tit) watts 


= qygedDid) hp 


Substituting Eqs. (6-111) and (6-112) into Eq. (6-118), we have 


p(t) = nigh K TQOntt) hp 
Also, it is known that 


At) = sey Tm(On(4) bP 


Therefore, equating Eq. (6-119) to Eq. (6-120) gives 


550 

K, = ygK, = 0.737K, 
or 

K, = 1.36K; 


Thus, given K, to be 0.5 lb-ft/amp, K, is found to be 0.68 volt/rad/sec. 


(6-118) 


(6-119) 


(6-120) 


(6-121) 


(6-122) 


Using Eqs. (6-107) through (6-116), the state equations of the system are 


written in the matrix form as follows: 
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| di,(t) R, K, nAK, i,(t) AK, 

dt L, La L, i L, 

dont) = x — Sn 0 jie} +] 0 (6.0) (6-123) 
#0 0 | 0 6,00 0 


The output equation is given by Eq. (6-117). The state diagram of the system 
is drawn as shown in Fig. 6-17. 


© i,(0 +)/s O Wn (0 +)/s O 8 (0 +)/s 


— nAK,/L, 


Fig. 6-17. State diagram of the positional control system in Fig. 6-16. 


When the initial states are assumed to be zero, the closed-loop transfer 
function of the system is obtained as 


8.(s) K,AK,n 


O(8) ~~ ReBnes(U + t.5)(0 + Tres) KyKis eK AKn (6-124) 
where 
= z = negligible 
Tme == Ine = 2 sec 
The error between the reference input and the output is defined as 
8.(t) = 0,(t) — 8,(t) (6-125) 
The open-loop transfer function of the system is obtained by use of Eq. (6-124), 
Therefore, 
G(s) = 99) K,AK in (6-126) 


6.(s) ~ R.BnS(l + 7,5)(1 + t.8) 1 KK 


The state transition equations of the system can be obtained from the state 
diagram by use of the gain formula, in the usual fashion. However, the main 
objective of this problem is to demonstrate the behavior of the time response of 
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the positional control system with respect to the system parameters, and it is 
sufficient to assume that all the initial states of the system are zero. 
Since L, is negligible, r, = 0, and the closed-loop transfer function in Eq. 
(6-124) is simplified to 
8.(s) K,AK,n 
8,(8) RameS* + (KyK; F R,Bne)S + K,AKin 


Equation (6-127) is of the second order; thus it can be written in the standard 
form of Eq. (6-81). The natural undamped frequency of the system is 
K,AKn 
Rad ne 


(6-127) 


On = ot (6-128) 


The damping ratio is 


C — K,K;, + RiBme _—. K,K; + RiB ne 


2R, I meOn 2./K,AK;RaJ men 
When the values of the system parameters are substituted into Eq. (6-127), the 
closed-loop transfer function of the system becomes 
8.5) 5A 
Os) s* + 34.58 + 5A 
Suppose that the gain of the de amplifier is arbitrarily set at 200. The natural 
undamped frequency and the damping ratio are, respectively, 


(6-129) 


(6-130) 


Wn = +31.6 rad/sec (6-131) 
¢ = 0.546 (6-132) 
The characteristic equation of the system is 
s* + 34.5s + 1000 = 0 (6-133) 
whose roots are 
Sj, 8, = —17.25 + 26.5 (6-134) 


Time Response to a Step Input 


Consider that the reference input is a unit step function, 6,(t) = u(t) rad; 
then the output of the system, under zero initial state condition, is 


1000 
= = - 
OAs Ec + 34.35 + 70007 | ei 
or 
Ot) = 1 + 1.2¢79 545 sin (0.837, -+ m + tan) 1.53 
@ me . ) (6-136) 


= 1+ 1.2e71725* sin (26.41 + 236.8°) 


The output response of the system is plotted in Fig. 6-18 as a function of the 
normalized time a,f. 

It is interesting to study the effects on the time response when the value of 
the gain A is varied. Note that in Eq. (6-128) and in Eq. (6-129), an increase in 
the gain A increases the natural undamped frequency o, but decreases the 
damping ratio ¢. For A = 1500, ¢ = 0.2, and w, = 86.2 rad/sec. The output 
response to a unit step displacement input for A = 1500 is plotted as shown in 
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Fig. 6-18. Time response of the positional control system in Fig. 6-16 when 
the input is a unit step displacement. 


Fig. 6-18. In this case the overshoot is very high, although the rise time and 
delay time are apparently reduced, The settling time is also shortened by the 
increase in A, although the responses in Fig. 6-18 do not show this because the 
time axis is normalized by w,. In fact, in Fig. 6-18 the step response for A = 
1500 seems to take a longer time to reach the steady state than that for A = 200, 
This is distorted by the normalized time axis; for A = 1500, wm, = 86.2 rad/sec, 
as compared to w, = 31.6 rad/sec for A = 200. 

When 4 is set at a relatively low value, 13.5, the damping ratio and the 
natural undamped frequency are { = 2.1 and @, = 8.22 rad/sec, respectively, 
Since ¢ is greater than one, the step response corresponding to A == 13.5 is over- 
damped. Table 6-2 gives the comparison of the time responses of the system for 
the three different values of A used. 


Table 6-2 Comparison of Transient Response of a Second-Order Positional 
Control System When the Gain Varies 


————-_-—— ———— eee 


Damping Maximum 
Gain A Ratio € On Overshoot Ta T; Ts tmax 
13.5 2.1 8.22 0 0.325 1.02 1.51 — 
200 0.546 31.6 0.13 0.043 0.064 0.174 0.119 


1500 0.2 86.6 0.52 0.013 0.015 0.17 0.037 
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When the value of A is set at 13.5 and 200, the roots of the characteristic 
equation are determined and listed as follows: 


ASS 66S 2i 324 
A=200 54,5, = —17.25 + j26.5 


These roots, together with the ones for A = 1500, are located in the s-plane 
as shown in Fig. 6-19. In general, for any value of A, the roots of the character- 
teristic equation are given by 


(se S172 s 5/1190 —30A (6-137) 


— j26.5 
A=59.5 
Root loci 


— {86 


Fig. 6-19. Root locus diagram of the system in Fig. 6-14. 


Therefore, for values of A between zero and 59.5, the two roots are real and lie 
on the negative real axis in the s-plane, and the system is overdamped. For 
values of A greater than 59.5, the roots are complex conjugate; the real parts of 
the roots are equal to —17.25 and are not affected by the value of A. Therefore, 
as A approaches infinity, the damping factor of the second-order system is always 
equal to 17.25 sec". When A varies continuously between —oo and oo, the 
two roots of the characteristic equation trace out two continuous loci in the 
s-plane, as shown in Fig. 6-19. In general, these are called the root loci of 
the characteristic equation or of the control system. In control system studies a 
root-locus diagram can be very useful for analysis and design once the relation- 
ship between the root location and the transient behavior has been established. 
In this case Fig. 6-19 shows that the second-order system is always stable for all 
finite positive values of A. When A is negative, one of the roots is positive, 
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which corresponds to a time response that increases monotonically with time, 
and the system is said to be unstable. The dynamic characteristics of the transient 
response as determined from the root-locus diagram of Fig. 6-19 are summarized 
as follows: 


Amplifier Gain Characteristic Equation Roots System Dynamics 
0<A< 59.5 Two negative distinct real Overdamped (€ > 1) 


roots 
A = 59.5 Two negative equal real Critically damped 
roots ¢=1) 


59.5 < A< oo Two complex conjugate roots Underdamped (¢ < 1) 
with negative real parts 

—co<A<0 Two distinct real roots, one Unstable system 
positive and one negative (¢ <0) 


Since the system under consideration is of type I, the steady-state error of 
the system is zero for all positive values of A, when the input is a step function. 
In other words, for a step input, the positional error constant K » iS to be used. 
Substituting the open-loop transfer function G(s) for the system and A(s) = 1 
into Eq. (6-21), we have 


ae SA = : 
A, > lit [oa (cee 
Therefore, the steady-state error is given by Eq. (6-22) as 
R 
C55 = T+K, = 0 (6-139) 


The unit step responses of Fig. 6-18 verify this fact. 


Time Response to a Ramp Input 
When a unit ramp function input 6,(t) = tu,(t) is applied to the control sys- 
tem of Fig. 6-16, the output response is described by 


0.(t) = | sortase 


From the Laplace transform table, Eq. (6-140) is written 


2 


(6-140) 


0.(t) =1 — - + vai pe sin lon =F) (6-141) 


where 


= dean (6-142) 


The ramp responses for A = 13.5, 200, and 1500 are sketched as shown in 
Fig. 6-20. Notice that in this case the steady-state error of the system is nonzero. 
As seen from Eq. (6-141), the last term will decay to zero as time approaches 
infinity. Therefore, the steady-state response of the system due to a unit ramp 
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e,(A = 1500) 
A= 1500 


6,(t) = tus(t) 


A= 13.5 


@,8,(t) 


Fig. 6-20. Output response (normalized) of the control system in Fig. 6-16 
when the input is a unit ramp function. 


input is 
lim 0,(¢) = lim E cae (6-143) 
f00 t-090 On 
It is simple to see that the steady-state error due to the unit ramp input is 
_ 26 34.5 7 
= 6 Sa (6-144) 


which is a constant. 
A more systematic method of determining the steady-state error to a ramp 
input is to use the velocity error constant K,. From Eq. (6-26), 


ine 4 5A SA : 


Therefore, from Eq. (6-27), 
e.5 = K Fo (6-146) 
which agrees with the result of Eq. (6-144). 


Equation (6-146) shows that the steady-state error is inversely proportional 
to the magnitude of A. However, if we choose to improve the steady-state accu- 
racy of the system by increasing the forward gain, the transient response becomes 
more oscillatory. This phenomenon is rather typical in all control systems. For 
higher-order systems, if the loop gain of the system is too high the system may 
become unstable. 
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Transient Response of a Third-Order System 


It was shown in the last section that if the armature inductance L, of the 
de motor is neglected, the control system is of the second order and is stable for 
all positive values of .A. Suppose now that we let L, = 0.1 henry in the sys- 
tem in Fig. 6-16 and keep the other parameters unchanged. The armature time 
constant t, is now 0.02 sec. The closed-loop transfer function given by Eq. 
(6-124) is now 


gs) i 0.05.4 (6-147) 
(s)  0.005s(1 + 0.025) + 2s) +- 0.345 + 0.054 
or 
Os) _ 250A id 
9s) 53 50.58? + 17255 + 250A (188) 
The open-loop transfer function is 
G(s) = 94S) _ eu (6-149) 


9.(s) — s(s? -+- 50.5s + 1725) 
The characteristic equation of the system is 
5? + 50.55? + 1725s +- 2504 = 0 (6-150) 


It is apparent that when the armature inductance is restored, the system is now 
of the third order, 
If we let A = 13.5, the closed-loop transfer function of Eq. (6-147) becomes 


BAO) es 22 5 neta Sas (6-151) 
8(s) ~ (1 + 0.485). £ 0.02985 -- 0.000616s7) 
The characteristic equation has a real root at 5 = —2.08 and two complex roots 


at —24.2 + 732.2. Fora unit step function input the output response is 
6.(t) = 1 — 1.06e-?-°8 +. 0.0667¢-24.2« sin(32.2t + 1.88) (6-152) 


In Eq. (6-152), since the time constant of the pure exponential term is more 
than 10 times greater than that of the damped sinusoid term, the transient re- 
sponse of @,(t) is predominantly governed by the characteristic root at s = 
—2,08. The response due to the last term of Eq. (6-152) decreases to zero very 
rapidly with the increase of t. Comparing Eq. (6-152) with Eq. (6-136) we see 
that the damping factor for the second-order system (L, = 0) is 17.25, whereas 
for the third-order system (L, = 0.1) the output response is governed by the 
exponential term, which has an equivalent damping factor of 2.08. Thus the 
third-order system will have a slower rise time. This result is expected, since 
the presence of inductance will slow down the buildup of the armature current, 
thus slowing down the torque development of the motor. However, higher induc- 
tance will cause a higher overshoot in the step response, as shown in Fig. 6-21. 
With L, = 0.1 H, and A = 348, the characteristic equation of Eq. (6-150) is 
factored as 

(s + 50.5)(s? + 1725) = 0 (6-153) 


Thus the characteristic equation has two imaginary roots at s = — J41.5. The 
response corresponding to these imaginary roots is an undamped sinusoid. The 


6,(t) 


0 0.1 0.2 


0.3 0.4 0.5 0.6 
Time (second) 


Fig. 6-21. Unit step response of the positional control system of Fig. 6-16 
with varying inductance, A = 200. 


— 25.25 — 2.08 


Fig. 6-22. Root loci of the characteristic equation of Eq. (6-150) when A 
is varied from zero to infinity. 


294 


Sec. 6.7 Effects of Derivative Control on the Time Response / 295 


frequency of the sinusoidal response is 41.5 rad/sec. When the roots of a charac- 
teristic equation lie on the imaginary axis of the s-plane, such as in the present 
situation, the linear system is said to be on the verge of instability. 

Figure 6-22 shows the root loci of the characteristic equation of Eq. (6-150) 
when 4 is varied from zero to infinity. For all values of A greater than 348, the 
two complex roots are found in the tight-half of the s-plane, and, with time, 
the step response of the third-order system will increase without bound. 

From this illustrative example we have learned that a second-order system 
is always stable as long as the loop gain is finite and positive; third- and higher- 
order systems may become unstable if the loop gain becomes high. 


6.7 Effects of Derivative Control on the Time Response of 
Feedback Control Systems 


The control systems considered thus far in this chapter are all of the propor- 
tional type, in that the system develops a correcting effort that is proportional 
to the magnitude of the actuating signal only. The illustrative example given in 
Section 6.6 shows that a proportional type of control system has the limitation 
or disadvantage that it is often difficult to find a proper forward path gain so that 
the steady-state and the transient Tesponses satisfy their respective requirements. 
Often, in practice, a single gain parameter is seldom sufficient to meet the design 
requirements on two performance criteria. 

It is logical to perform other operations, in addition to the proportional 
control, on the actuating signal. In terms of signal processing, we may perform 
a time derivative of the actuating signal. Figure 6-23 shows the block diagram 


Wn 
s(s + 2Fu,,) 


Fig. 6-23. Feedback control system with derivative control. 


of a typical second-order feedback control system with derivative control added 
to the proportional control. In this case the constant Tz Tepresents the amount 
of derivative control used in proportion to the ordinary proportional control. 
The open-loop transfer function of the system is now 


Cs) onl + ts) 5 
APs. Oaht Ta S) -154 
E(s) ~ s(8 -F Xen,) ne 
Analytically, Eq. (6-154) shows that the derivative control is equivalent to the 
addition of a simple zero at s = —1/t,z to the open-loop transfer function. 
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c(t) 


0 
e(t) 
1 
0 t 
fh t3 ty ts 
(b) 
de(t) 
dt ts 
0 t 
ty tg ty 
(c) 


Fig. 6-24. Waveforms of c(t), e(t), and de(t)/dt showing the effect of deriva- 
tive control. (a) Step response. (b) Error signal. (c) Time rate of change of 
error signal. 


The effect of the derivative control on the transient response of a feedback 
control system can be investigated by referring to Fig. 6-24. Let us assume that 
the unit step response of a proportional type of system is shown in Fig. 6-24(a). 
The corresponding error signal e(t) and the time derivative of e(t) are as shown 
in Fig. 6-24(b) and (c), respectively. Notice that under the assumed case the step 
response exhibits a high peak overshoot. For a system that is driven by a motor 
of some kind, this large overshoot is due to the excessive amount of torque 
developed by the motor in the time interval 0 < t < t,, during which the error 
signal is positive. For the time interval tr, < ¢ < f,, the error signal is negative, 
and the corresponding motor torque is negative. This negative torque tends to 
reverse the direction of motion of the output, thus causing c(t) to undershoot 
during t,; <t<t,. During the time interval t,; <t< 1, the motor torque is 
again positive, thus tending to reduce the undershoot in the response caused by 
the negative torque in the previous interval. Since the system is assumed to be 
stable, the error amplitude is reduced with each oscillation, and the output 
eventually is settled to its final desired value. 

Considering the explanation given above, we can say that the contributing 
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factors to a high overshoot are as follows: (1) The positive correcting torque 
in the interval 0 < t < ¢, is too large, and (2) the retarding torque in the time 
interval 1, < t < f, is inadequate. Therefore, in order to reduce the overshoot 
in the step response, a logical approach is, to decrease the amount of positive 
correcting torque and to increase the retarding torque. Similarly, in the time 
interval t, < t < t,, the negative corrective torque should be reduced, and the 
retarding torque, which is now in the positive direction, should be increased in 
order to improve the undershoot. 

The derivative control as represented by the system of Fig. 6-23 gives pre- 
cisely the compensation effect described in the last paragraph. Let us consider 
that the proportional type of control system whose signals are described in Fig. 
6-24 is now modified so that the torque developed by the motor is proportional 
to the signal e(t) + t,de(t)/dt. In other words, in addition to the error signal, a 
signal that is proportional to the time rate of change of error is applied to the 
motor. As shown in Fig. 6-24(c), for 0 < t < t,, the time derivative of e(t) is 
negative; this will reduce the original torque developed due to e(t) alone. For 
ty <t< bh, both e(t) and de(t)/dt are negative, which means that the negative 
retarding torque developed will be greater than that of the proportional case. 
Therefore, all these effects will result in a smaller overshoot. It is easy to see that 
e(t) and de(t)/dt have opposite signs in the time interval t, <t<t,; therefore, 
the negative torque that originally contributes to the undershoot is reduced also. 

Since de(t)/dt represents the slope of e(t), the derivative control is essentially 
an anticipatory type of control. Normally, in a linear system, if the slope of e(#) 
or c(t) due to a step input is large, a high overshoot will subsequently occur. 
The derivative control measures the instantaneous slope of e(t), predicts the large 
overshoot ahead of time, and makes a proper correcting effort before the over- 
shoot actually occurs. 

It is apparent that the derivative control will affect the steady-state error of 
a system only if the steady-state error varies with time. If the steady-state error 
of a system is constant with respect to time, the time derivative of this error is 
zero, and the derivative control has no effect on the steady-state error. But if the 
steady-state error increases with time, a torque is again developed in proportion 
to de(t)/dt, which will reduce the magnitude of the error. 

Consider that the positional control system of Fig. 6-16 is modified by 
replacing the dc amplifier with derivative control so that the open-loop transfer 
function is now 


O(s)__ SACL +- tys) 
8.(s) ~ s(s + 34.5) (6-155) 


Figure 6-25 illustrates the unit step responses of the closed-loop system 
when A = 13.5 and rt, = 0.01, 0.1, and 1.0. Notice that in the case of the low 
value for A, an increasing value of z, has the effect of slowing down the response, 
and the damping is increased. Figure 6-26 illustrates the unit step responses 
when A = 1500. In this case the damping is noticeably improved by the deriva- 
tive control. When t, = 0, Fig. 6-18 shows that the overshoot is 52 per cent for 
A = 1500, whereas with t, = 0.01, the overshoot is reduced to approximately 
14 per cent. When 1; = 0.1, the overshoot is completely eliminated, but the step 


6,(t) 


4, (t) 


298 


1.0 2.0 3.0 
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Fig. 6-25. Step responses of the positional control system of Fig. 6-16 with 
derivative control; A = 13.5. 


0.01 0.02 0.03 0.04 0.05 0.06 0.07 
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Fig. 6-26. Step responses of the positional control system of Fig. 6-16 with 
derivative control; A = 1500. 
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response is slow in reaching its final value. Figure 6-26 also shows the step 
response for 7, = 1.0. 

The effect of derivative control on the transient response of a feedback 
control system can also be studied by referring to the open-loop transfer func- 
tion of Eq. (6-154). The corresponding closed-loop transfer function of the 
system is 

C(s) _ (1 + tase? 6-156 
Ris) 8? + lo, + tacoz)s + oF CP) 
The characteristic equation of the system is 
s? + (Leo, + tacoz)s + w2 = 0 (6-157) 
Notice that the derivative control has the effect of increasing the coefficient of 
the s term by the quantity 7,2. This means that the damping of the system is 
increased. Using the values as represented by Eq. (6-155), the characteristic 
equation becomes 
s* + (34.5 + 5At,)s + 54=0 (6-158) 
Figure 6-27 shows the loci of the roots of Eq. (6-158) when A = 13.5 and 7, is 
varied from 0 to co. The improvement on the system damping due to the deriva- 
tive control is illustrated by the root loci of Fig. 6-28 with A set at 1500. Notice 
that for small values of t,, the roots of the characteristic equation are still com- 
plex, although they are farther away from the imaginary axis than those when 
Tz = 0. For large values of ¢,, the roots become real. 


s-plane 


Tq =0 


Fig. 6-27. Root loci of the characteristic equation of Positional control 
system with derivative control, s? + (34.5 + 5Ata)s + 5A =0,A = 13.5. 


It should be pointed out that although the derivative control as fashioned 
by the scheme shown in Fig. 6-23 generally improves the damping of a feedback 
control system, no considerations have been given here on the practicability of 
the configuration. In practice, however, the transfer function of (1 + 4,5) cannot 
be physically realized by passive elements. Furthermore, derivative control has 
the characteristics of a high-pass filter which tends to propagate noise and dis- 
turbances through the system. Practical controllers which are used to improve 
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s-plane 


~~ j86 


Ty =0 


Fig. 6-28. Root loci of the characteristic equation of positional control 
system with derivative control; s? + (34.5 + 5Atg)s + 5A == 0, A = 1500, 


the performance of control systems usually have more complex transfer func- 
tions than that of the derivative controller illustrated here. 


6.8 Effects of Integral Control on the Time Response of 
Feedback Control Systems 


The counterpart of derivative control is the integral control that introduces a 
signal in proportion to the time integral of the error. Figure 6-29 illustrates the 
basic scheme for the integral control applied to a second-order system. The signal 
applied to the process consists of two components: one proportional to the 
instantaneous error signal, the other, to the time integral of the error. The 
parameter K, is a proportional constant. The open-loop transfer function of 
the system is 

C(s) _ _an(s + Ki) z 

EG) * 56 + Xo) ne 


Cs) 


s(s + 2f0,) 


Integral control 


Fig. 6-29. Feedback control system with integral control. 


(a) 


Sec. 6.8 Effects of Integral Control on the Time Response / 301 


One obvious effect of the integral control is that it increases the order of the sys- 
tem by J. More important is that it increases the type of the system by 1. There- 
fore, the steady-state error of the original system without integral control is 
improved by an order of 1. In other words, if the steady-state error to a given 
input is constant, the integral control reduces it to zero. In the case of Eq. 
(6-159), the system will now have a zero steady-state error when the input is a 
ramp function. However, because the system is now of the third order it tends 
to be less stable than the original second-order system. In fact, if the loop gain 
of the system is high, the system may be unstable. 
Let us consider the positional control system of Fig. 6-16 again, with L, = 
0. With the integral control, the open-loop transfer function of the system be- 
comes 
0.(s)__ 5A(s + K;) 
0.(s) — s*(s + 34.5) 
The characteristic equation is 
58° + 34.55? + SAs + SAK, =0 (6-161) 
The effect of the value of K. , On the transient behavior of the system may be 
investigated by plotting the roots of Eq. (6-161) as a function of A. Figure 6-30 


(6-160) 


(b) 


Fig. 6-30. (a) Root loci of the characteristic equation of a feedback control 
system with integral control, s3 + 34,552 + 5As + 5AK; =0, Ki < 
34.5. (b) Root loci of the characteristic equation of a feedback control sys- 
tem with integral control, s3 + 34.552 + 5As + 5AK; =0, Ki = 34,5. 
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(c) 


Fig. 6-30 (Cont.). (c) Root loci of the characteristic equation of a feedback 
control system with integral control, s3 + 34.5s2 + SAs -- 5AK,; =0, 
K, > 34.5. 


illustrates the root loci of Eq. (6-161) for three different values of K, and when A 
varies between zero and infinity. Notice that when K, lies between 0 and 34.5, the 
roots of the characteristic equation all lie in the left half s-plane. When K, = 
34.5, the system becomes second order and the two roots lie on the jq-axis for all 
values of A between 0 and oo, and the system is on the verge of instability. When 
the value of K, exceeds 34.5, the system with the integral control is unstable for 
all values of A. 

As an alternative, we can fix the value of A and show the effect of varying 
K, on the roots of the characteristic equation. Figure 6-31 shows the root loci 
of Eq. (6-161) with A = 13.5 and 0 < K, < ow. 

To verify the analytical results obtained in the preceding sections, Fig. 6-32 
shows the step responses of the system with A = 13.5 and K, = 1, 10, and 34.5. 
As predicted by the root loci of Figs. 6-30 and 6-31, the response for K, = 34.5 
is a pure sinusoid. 


6.9 Rate Feedback or Tachometer Feedback Control 


The philosophy of using the derivative of the actuating signal to improve the 
damping of a system can be applied to the output signal to achieve a similar 


Fig. 6-31. Root loci of the characteristic equation of a feedback control 
system with integral control, s3 + 34.552 t 5As + SAK, =0, A = 13.5, 
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Fig. 6-32. Step responses of the positional control system of Fig. 6-16 with 
a = 0 and integral control, A = 13.5, 
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effect. In other words, the derivative of the output signal is fed back and com- 
pared with the reference input. In practice, if the output variable is mechanical 
displacement, a tachometer may be used which converts the mechanical dis- 
placement into an electrical signal that is proportional to the derivative of the 
displacement. Figure 6-33 shows the block diagram of a second-order system 
with a secondary path that feeds back the derivative of the output. The transfer 
function of the tachometer is denoted by K,s, where K, isthe tachometer constant, 
usually expressed in volts/unit velocity. 


C(s) 


Fig. 6-33. Second-order system with tachometer fecdback. 


The closed-loop transfer function of the system of Fig. 6-33 is 


Cs) __ On : 
R(s) s* + (lw, + Ko2)s + w; (Gis2) 


and the characteristic equation is 
s? + (2lo, + Kon)s + wr = 0 (6-163) 


Comparing Eq. (6-163) with Eq. (6-157), which is the characteristic equation of 
the second-order system with derivative control, we see that the two equa- 
tions are of the same form. In fact, they are identical if rt, is interchanged with 
K,. Therefore, we conclude that the rate or tachometer feedback also im- 
proves the damping of a feedback control system. However, it should be noted 
that the closed-loop transfer function of Eq. (6-162) does not have a zero, 
and thus the responses of the two systems will not be identical even if K, 
equals 7,. 

The open-loop transfer function of the system with tachometer feedback is 
obtained from Fig. 6-33: 


C(s) __ wo if 
Hs) 5G Wo, pKa) Gl) 


The system is still of type 1, so the basic characteristic of the steady-state error 
is not altered. However, for a unit ramp function input, the steady-state error to 
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the system of Fig. 6-23 which has the derivative control is 2€/@,, whereas that 
of the system in Fig. 6-33 is (26 + K,a,)/a,. 


6.10 Control by State-Variable Feedback4:5 


One of the design techniques in modern control theory is that instead of using 
controllers that have dynamics and feedback from the output variable, flexibility 
can be gained by feeding back some or all of the state variables to control the 
process. In the system with tachometer feedback, shown in Fig. 6-33, if we 
decompose the process in the forward path by direct decomposition, we can 
show that the system is actually equivalent to having state feedback. Figure 
6-34(a) shows the state diagram of the process 


Cs)_ 
E(s) s(s + 2a,) 
which is decomposed by direct decomposition. If the states x, and X, are phys- 
ically accessible, we may feed back these variables through individual gains, as 
shown in Fig. 6-34(b), to give closed-loop control of the process. 
The closed-loop transfer function of the system in Fig, 6-34(b) is 


C(s) On 
R(s) ss? + (lo, + 25 +g, 


(6-165) 


(6-166) 


— fw, 


(a) 


(b) 


Fig. 6-34. Control of a second-order system by state feedback. 
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Comparing this transfer function with that of the system with tachometer feed- 
back, Eq. (6-162), we notice that the two transfer functions would be identical 
if zg, = w? and g, = K,q?. In fact, in selecting the feedback gains g, and g,, in 
order to have zero steady-state error for a step input, g, should equal @?. The 
value of g, is selected to satisfy the damping requirements of the system. 

The significance of this illustration is that, if all the state variables are 
available for feedback, we can achieve at least the same or better control with 
state feedback as with dynamic controllers and feeding back only the output. 
Note that the system with tachometer feedback shown in Fig. 6-33 has only the 
output variable available for feedback. If we regard the output as one of the 
states, it is fed back through a unity gain. The second state needed for feedback 
is actually “reconstructed” by the dynamics of the tachometer. In other words, 
the tachometer acts as an “observer” (see Chapter 11), which recovers the state 
variable from the output variable. 

In modern control theory, certain types of design algorithm, such as the 
linear regulator theory, naturally lead to state-variable feedback. Since the 
eigenvalues (or the poles of the closed-loop transfer function) of a linear system 
directly control the transient response of the system, it would be desirable if the 
designer is able to place the eigenvalues according to the performance specifica- 
tions. It is shown in Chapter I1 that if a system is completely controllable, the 
eigenvalues of the system can be placed arbitrarily. 

The following example gives an illustration on how the state feedback and 
eigenvalue assignment affect the time response of a linear control system. 


EXAMPLE 6-3. Consider that the transfer function of a linear process is 


_C(s)_ 20 
GS) =F) = FGF) 
Figure 6-35(a) shows the state diagram of G(s), and Fig. 6-35(b) shows the state dia- 
gram with feedback from all three states. The closed-loop transfer function of the sys- 
tem is 


(6-167) 


a 
R(s) 83 + (83 + Us? + 825 + 81 
Let us assume that we desire to have zero steady-state error with the input being a unit 
step function, and in addition, two of the closed-loop poles must be at s = —1 + / 
and s = —1 —j. The steady-state requirement fixes the value of g, at 20, and only 
g2 and g; need to be determined from the eigenvalue location. 
The characteristic equation of the system is 


3 + (g3 + Ds? + g25 + 20=(8 +1 ss +1 —-s/s +a) (6-169) 


Equating the coefficients of the corresponding terms in the last equation, we get 


(6-168) 


£2 = 22 and g3=11 


and the third pole is at s = —10. 

Since the complex closed-loop poles have a damping ratio of 0.707, and the third 
pole is quite far to the left of these poles, the system acts like a second-order system. 
Figure 6-36 shows that the unit step response has an overshoot of 4 per cent. 


c(t) 


x3 x3 x2 xy 


(a) 


(b) 
Fig. 6-35. Control of a third-order system by state feedback. 
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Fig. 6-36. Unit step response of the control system in Example 6-3. 
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PROBLEMS 


A pair of complex-conjugate poles in the s-plane is required to meet the various 
specifications below. For each specification, sketch the region in the s-plane in 
which the poles may be located. 
(a) € > 0.707, @, > 2rad/sec (positive damping) 
(b) 0< € < 0.707 wm < 2rad/sec (positive damping) 
(c) €<05,2<0,<4rad/sec (positive damping) 
(d) 0.5 < € < 0.707, w, <2 rad/sec (positive and negative damping) 
Determine the position, velocity, and acceleration error constants for the follow- 
ing control systems with unity feedback. The open-loop transfer functions are 
given by 

50 
(@) OS) = GOING Fas) 

K 

(6) OS) = PF Oind £055) 


i K 
(©) OS) = 5G as $200) 
_ Kd +25) + 4s) 
() Gs) = “SGT Fas + 10) 
For the systems in Problem 6.2, determine the steady-state error for a unit step 
input, a unit ramp input, and an acceleration input ¢2/2. 


The open-loop transfer function of a control system with unity feedback is 
_ 500 
CO = THis 


Evaluate the error series for the system. Determine the steady-state error of the 
system when the following inputs are applied: 
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(a) rt) = t7u,(2)/2 

(b) rt) = (1 + 2¢ + 2?)u,(1) 

Show that the steady-state error obtained from the error series is equal to the 
inverse Laplace transform of E(s) with the terms generated by the poles of 
E(s){R(s) discarded. 


6.5. In Problem 6.4, if a sinusoidal input r(t) = sin o¢ is applied to the system at 
t = 0, determine the steady-state error of the system by use of the error series 
for @ = 5S rad/sec. What are the limitations in the error series when r(t) is 
sinusoidal ? 


6.6. A machine-tool contouring control system is to cut the piecewise-linear contour 
shown in Fig. P6-6 with a two-axis control system. Sketch the reference input of 
each of the two-axis systems as a function of time. 


t=4.5 sec 7 sec 


Figure P6-6. 
6.7. A machine-tool contouring control system is to cut a perfect circular arc with 


a two-axis control system. Determine the reference inputs of the two systems 
that will accomplish this. 


6.8. A step motor gives a single step response shown in Fig. P6-8 after a pulse exci- 


Step position 1 


Step position 0 


Figure P6-8. 
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6.9. 


Desired 
attitude 


6.10. 


6.11. 


tation is applied. Find a linear second-order transfer function to model the 
motor for this operation. 


The attitude control of the missile shown in Fig. P5-11 is accomplished by thrust 
vectoring. The transfer function between the thrust angle 6 and the angle of 
attack @ can be represented by 
_s)__K 
GO) 565 a 


(refer to Problem 5.11) where K and a are positive constants. The attitude con- 
trol system is represented by the block diagram in Fig. P6-9. 


Attitude rate 
sensor K,s 


Attitude 
sensor K, 


Figure P6-9. 


(a) In Fig. P6-9, consider that only the attitude sensor loop is in operation 
(K, = 0). Determine the performance of the overall system with respect to 
the relative values of K, K,, and a. 


(b) Consider that both loops are in operation. Determine the minimum values 
of K, and K, in terms of K and a so that the missile will not tumble. 

(c) It is desired that the closed-loop system should have a damping ratio of € 
and a natural undamped frequency of @,,. Find the values of K, and K; in 
terms of €, w,, a, and K. 

A controlled process is represented by the following state equations: 

X;= X, — 3x2 
X2 = 5x 1 + u 
The control is obtained from state feedback such that 
u = —£1X%1 — B2X2 

where g; and g, are real constants. 

(a) Find the locus in the g, versus g2 plane on which the overall system has a 
natural undamped frequency of ,/2 rad/sec. 

(b) Find the locus in the g; versus g2 plane on which the overall system has a 
damping ratio of 70.7 per cent. 

(c) Find the values of g; and g, such that € = 0.707 and w, = ./2 rad/sec. 

Given a linear time-invariant system which is described by the state equations 


x = Ax + Bu 
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where 
0 1 0 0 
A= 0 0 1 B=! 0 
—-1] -2 -—3 1 


The input w is a unit step function. Determine the equilibrium state which 
satisfies Ax + Bu = 0. 


Repeat Problem 6.11 when 


0 1 0 0 
A=!/0 0 1 B=] 0 
0 ~—2 —3 1 


The block diagram of a missile attitude control system is shown in Fig, P6-13; 
control is represented by u(t), and the dynamics of the missile are represented 
by 


9, (t) 


Desired output 


Input 
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The attitude controller is represented by G,(s), and 99(s) is the actual heading or 

output. 

(a) With G,(s) = 1, determine the response of the system, 0o(t), when the input 
6,(t) is a unit step function. Assume zero initial conditions. Discuss the 
effects of L and J on this response. 

(b) Let G(s) = (1 + Ts), L = 10, and J = 1000. Determine the value of 7, 
so that the system is critically damped. 

(c) It is desired to obtain an output response with no overshoot (see Fig. 
P6-13); the response time may not be minimum. Let G,(s) = 1, and the 
system is controlled through the input 8,(¢), which is chosen to be of the 
form shown. Determine the values of k and tf; so that the desired output 
is obtained. Use the same values of L and J as given before. 


6.14. The block diagram of a simple servo system is shown in Fig. P6-14. 


Amplifier 
gain K 


Figure P6-14. 


(a) For K = 10, determine the values of a and 4 to give an overshoot of 16 
per cent and a time constant of 0.1 sec of the system response to a unit step 
input. Time constant is defined here as the inverse of the damping factor. 

(b) If the value of K is decreased slightly, how does it affect the damping ratio 
of the system? 

(c) Plot several points on the loci of roots of the system characteristic equation 
as K is varied from zero to infinity. 


6.15. The parameters of the positioning servo system shown in Fig. P6-15 are given 


below: 
J, = load inertia 1 ft-lb/rad/sec? 
B, = load viscous friction 0.00143 ft-lb/rad/sec 
Jm = motor inertia 8 x 10-4 ft-lb/rad/sec? 
Bm = motor viscous friction negligible 
Ry = generator field resistance 50 
L; = generator field inductance 5 henry 
R, = total armature resistance of generator and 
motor 48.8 D2 
XK, == motor torque constant 0.812 ft-lb/A 
K, = generator constant 200 volts/amp 
L, = total armature inductance of generator and 
motor negligible 


(a) For an amplifier gain of K = 100, find the roots of the characteristic equa- 
tion of the system. Locate these roots in the s-plane. 

(b) For K = 100, evaluate the output response @,(¢) when 9,(f) is a unit step 
displacement input. Sketch the waveform of 6,(¢). 
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is = constant 


Amplifier 
gain K 


Motor to load gear 


: 1 
ration = 30 


Load to potentiometer 
gear ratio = 1/1 


1000° rotation 


Figure P6-15. 


(c) Repeat parts (a) and (b) for K = 60.7. 
(d) Repeat parts (a) and (b) for K = 50. How does the steady-state response 
of 6,(¢) compare with the reference input 6,(t)2 


6.16. The following parameters are given for the servo system shown in Fig. P6-16. 


de 
R L motor Ir = constant 


Demodulator 
Ka 


Synchros 


Figure P6-16. 
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K, = sensitivity of error detector 1 volt/rad 

J, = load inertia 0.05 ft-lb/rad/sec? 
B,, = load viscous friction 0.005 ft-lb/rad/sec 
Jm = motor inertia 0.05 ft-lb/rad/sec? 
B; = motor viscous friction negligible 

K; = motor torque constant 1 ft-lb/amp 

L, = motor armature inductance negligible 

R, = motor armature resistance 10Q 

K, = gain of demodulator 1 volt/volt 

Gear ration = N,/N2 1:1 


(a) Write the characteristic equation of the system and determine the value of 
the dc amplifier gain A for a critically damped system. 

(b) For a unit ramp function input 0,(t) = tu,(t), what should be the minimum 
value of A so that the steady-state value of the response 6@,(ft) will follow 
the reference input with a positional error not exceeding 0.0186 rad? With 
this gain setting, evaluate the output response @,(:). 


6.17. In the feedback control system shown in Fig. P6-17, the sensitivity of the syn- 
chro error detector is 1 V/deg. After the entire system is set up, the transfer 
function of the two-phase motor is determined experimentally as 


6,8) = Kn 
Ex(s)~ s( + TS) 


where K,, = 10 voits-sec, and 7,, = 0.1 sec. 


ac 7 Amplifier ° 
60 ~ ° 5 
/ 2-phase 


/ servomot 


0. = 81 Om = 100 6, 


Figure P6-17. 


(a) If the load on the output shaft is to be driven in its steady state at a constant 
speed of 30 rpm, what is the minimum value of gain A of the amplifier in 
order that the deviation between output and input positions will not exceed 
3° when the steady state is reached? 

(b) The gain of the amplifier is given by A = 35. Determine the damping ratio 
C and the undamped natural frequency of the system. 


Chap. 6 Problems / 315 


(c) The amplifier is modified to differentiate the error signa! so that the output 
of the amplifier is written 


ex(t) = Ae(t) + ATO 


where A = 35, Determine the value of T, so that the damping ratio is 40 
per cent. Repeat part (a) with the modified amplifier. 
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Stability of Control Systems 


7.1 


Introduction 


It was shown in Chapter 6 that the transient response of a linear feedback control 
system is governed by the location of the roots of the characteristic equation. 
Basically, the design of linear feedback control systems may be regarded as 
a problem of arranging the location of the characteristic equation roots in such 
a way that the corresponding system will perform according to the prescribed 
specifications, We shall learn in Chapter 11 that there are conditions the system 
must satisfy before its characteristic equation roots can be arbitrarily assigned. 

Among the many forms of performance specifications used in the design 
of control systems, the most important requirement is that the system must be 
stable at all times. However, there are various ways of defining stability, espe- 
cially when we include all types of systems, such as linear and nonlinear, 

In any case, the notion of stability is used to distinguish two classes of 
systems: useful and useless. From a practical standpoint, a stable system may 
be useful, whereas an unstable system is useless. 

In essence, the analysis and design of linear control systems is centered on 
stability studies. The notion of stability may be expanded to include absolute 
stability and relative stability. Absolute stability refers to the condition of 
stable or unstable. Once the system is found to be stable, it is of interest to 
determine how stable it is, and the degree of stability is measured by relative 
stability. Parameters such as overshoot and damping ratio used in relation to 
the transient response in Chapter 6 provide indications of the relative stability 
of a linear time-invariant system in the time domain. 
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In this chapter we are concerned with the subject of absolute stability of 
control systems, which is simply a yes or no Proposition. 

From the illustrative examples of Chapter 6 we may summarize the relation 
between the transient response and the characteristic equation roots as follows: 


1. When all the roots of the characteristic equation are found in the 
left half of the s-plane, the system responses due to the initial con- 
ditions will decrease to zero as time approaches infinity. 

2. If one or more pairs of simple roots are located on the imaginary 
axis of the s-plane, but there are no roots in the right half of the 
s-plane, the responses due to initial conditions will be undamped 
sinusoidal oscillations. 

3. If one or more roots are found in the right half of the s-plane, the 
responses will increase in magnitude as time increases. 


In linear system theory, the last two categories are usually defined as 
unstable conditions. Note that the responses referred to in the above conditions 
are due to initial conditions only, and they are often called the Zero-input re- 
Sponses. 


7.2 Stability, Characteristic Equation, and the State 
Transition Matrix 


We can show from a more rigorous approach that the zero-input stability of 
a linear time-invariant system is determined by the location of the roots of the 
characteristic equation or the behavior of the state transition matrix o(t). 

Let a linear time-invariant system be described by the state equation 


%(¢) = Ax(t) + Bu(t) (7-1) 


where x(t) is the state vector and u(t) the input vector. For zero input, x(t) = 0 
satisfies the homogeneous state equation X(t) = Ax(t) and is defined as the 
equilibrium state of the system. The zero-input stability is defined as follows: 
If the zero-input response x(t), subject to finite initial state X(ty), returns to the 
equilibrium state x(t) = 0 as t approaches infinity, the system is said to be stable; 
otherwise, the system is unstable. This type of stability is also known as the as- 
ymptotic stability. 

In a more mathematical manner, the foregoing definition may be stated: 
A linear time-invariant system is said to be stable (zero input) if for any finite 
initial state x(t)) there is a positive number M [which depends on x(t,)] such that 


qd) [x@ |< for allt >t, (7-2) 
and 
(2) lim 1x) || = 0 (7-3) 
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where ||x(t)|| represents the norm* of the state vector x(t), or 


xl =| xr)” (7-4) 


The condition stated in Eq. (7-2) implies that the transition of state for any 
t > f, as represented by the norm of the vector x(t) must be bounded. Equation 
(7-3) states that the system must reach its equilibrium state as time approaches 
infinity. 

The interpretation of the stability criterion in the state space is illustrated 
by the second-order case shown in Fig. 7-1. The state trajectory represents the 
transition of x(t) for t > t) froma finite initial state x(¢.). As shown in the figure, 
x(t) is represented by a point that is the tip of the vector obtained from the 
vector sum x,(f,) and x,(t,). A cylinder with radius M forms the upper bound 
for the trajectory points for all t > ft), and as ¢ approaches infinity, the system 
reaches its equilibrium state x(t) = 0. 


x2 


X4 (tg) 


Fig. 7-1. Stability concept illustrated in the state space. 


Next we shall show that the definition of stability of linear time-invariant 
systems given above leads to the same conclusion on the condition of the roots 
of the characteristic equation. For the zero-input condition, the state transition 
equation of the system is 


x(t) = O(¢ — to)x(to) (7-5) 


where (¢ — f,) is the state transition matrix. 
Taking the norm on both sides of Eq. (7-5) gives 


I x(2)1] = 116 — t0)(to) I (7-6) 


*The norm of a vector is the generalization of the idea of length. ||x|] is always a real 
number. 


7.3 Stability of 
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An important property of the norm of a vector is 


I X@) {1 < [OC — to) [HII x(¢0) || (7-7) 
which is analogous to the relation between lengths of vectors. 
Then the condition in Eq. (7-2) requires that Il @(t — t,)]]]| x(t) || be finite. 
Thus, if || x(tq)|| is finite as postulated, || @(¢ — f5)|| must also be finite for ¢ > ty. 
Similarly, Eq. (7-3) leads to the condition that 


lim || $(¢ — to)|| = 0 (7-8) 
or 
lim b(t — to) = 0 (7-9) 


i,j = 1,2,...,n, where ¢,(t — t,) is the ijth element of $(¢ — 1,). 
In Eq. (4-42) the state transition matrix is written 


$(t) = £-[(sl — A)~!] (7-10) 
or 
(9 = o-1[ SUT A) ae (7-11) 


Since |sI — A] = 0 is the characteristic equation of the system, Eq. (7-11) 
implies that the time response of (1) is governed by the roots of the characteris- 
tic equation. Thus the condition in Eq. (7-8) requires that the roots of the 
characteristic equation must all have negative real parts. 


Linear Time-Invariant Systems with Inputs 


Although the stability criterion for linear time-invariant systems given in the 
preceding section is for the zero-input condition, we can show that, in general, 
the stability condition for this class of systems is independent of the inputs. An 
alternative way of defining stability of linear time-invariant systems is as follows: 
A system is stable if its output is bounded for any bounded input. 
In other words, let ¢(t) be the output and r(r) the input of a linear system 

with a single input-output. If 

Ir(t)|< N < 00 for t > ty (7-12) 
then 

lceD|<M<oco for t > ty (7-13) 


However, there are a few exceptions to the foregoing definition. A differentiator 
gives rise to an impulse response at ¢ = ¢, when it is subjected to a unit step 
function input. In this case the amplitude of the input is bounded, but the 
amplitude of the output is not, since an impulse is known to have an infinite 
amplitude. Also, when a unit step function is applied to a perfect integrator, 
the output is an unbounded ramp function. However, since a differentiator and 
an integrator are all useful systems, they are defined as stable systems, and are 
exceptions to the stability condition defined above. 

We shall show that the bounded input—bounded output definition of stabi- 
lity again leads to the requirement that the roots of the characteristic equation 
be located in the left half of the 5-plane. 


320 / Stability of Control Systems Chap. 7 


Let us express the input-output relation of a linear system by the con- 
volution integral 


c(t) = ie r(t — t)g(t) at (7-14) 


where g(t) is the impulse response of the system. 
Taking the absolute value on both sides of Eq. (7-14), we get 


le =|f" ne — Date) az (7-15) 


Since the absolute value of an integral is not greater than the integral of 
the absolute value of the integrand, Eq. (7-15) is written 


le < fire — DI Ie¢@)| ar (7-16) 
Now if r(¢) is a bounded signal, then, from Eq. (7-12), 


lei < [ Nig@)ldc=N{ Ieee (7-17) 
it) 0 
Therefore, if c(t) is to be a bounded output, 
NI Is@lat<M<o (7-18) 
or 
fF is@lar< P< (7-19) 
0 


A physical interpretation of Eq. (7-19) is that the area under the absolute-value 
curve of the impulse response g(t), evaluated from t = 0 to f = oo, must be 
finite. 

We shall now show that the requirement on the impulse response for 
stability can be linked to the restrictions on the characteristic equation roots. 
By definition, the transfer function G(s) of the system and the impulse response 
g(t) are related through the Laplace transform integral 


G(s) = f° ee" at (7-20) 
Taking the absolute value on the left side of Eq. (7-20) gives 
IG)I< J le@llelat (7-21) 


The roots of the characteristic equation are the poles of G(s), and when s 
takes on these values, |G(s)| = oo. Also, s = 6 + ja; the absolute value of 
e~*t is |e~% |. Equation (7-21) becomes 


co < J la@llen lat (7-22) 


If one or more roots of the characteristic equation are in the right half or 
on the imaginary axis of the s-plane, o > 0, and thus |e-“|< N= 1. Thus 
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Eq. (7-22) is written 


co < J Mlewlae =f laolar (7-23) 


for Re(s) =a > 0. 

Since Eq. (7-23) contradicts the stability criterion given in Eq. (7-19), we 
conclude that for the system to be stable, the roots of the characteristic equation 
must all lie inside the left half of the s-plane, 

The discussions conducted in the preceding sections lead to the conclusions 
that the stability of linear time-invariant systems can be determined by checking 
whether any roots of the characteristic equation are in the right half or on the 
imaginary axis of the s-plane. The regions of stability and instability in the s- 
plane are illustrated in Fig. 7-2. The imaginary axis, excluding the origin, is 
included in the unstable region. 


jw 


s-plane 


Stable Unstable 


region 


Stable 
region 


Unstable 
region 


Fig. 7-2. Stable and unstable regions in the s-plane. 


7.4 Methods of Determining Stability of Linear Control Systems 


Although the stability of linear time-invariant systems may be checked by 
investigating the impulse response, the state transition matrix, or by finding 
the roots of the characteristic equation, these criteria are difficult to implement 
in practice. For instance, the impulse response is obtained by taking the inverse 
Laplace transform of the transfer function, which is not always a simple task; 
a similar process is required to evaluate the state transition matrix (f). The 
solving of the roots of a high-order polynomial can only be carried out by a 
digital computer. In practice, therefore, the stability analysis of a linear system 
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is seldom carried out by working with the impulse response or the state transi- 
tion matrix, or even by finding the exact location of the roots of the characteristic 
equation. In general, we are interested in algorithms that are straightforward 
to apply and which can provide answers to stability or instability, without 
excessive computations. The methods outlined below are frequently used for 
the stability studies of linear time-invariant systems. 


1. Routh-Hurwitz criterion’: an algebraic method that provides infor- 
mation on the absolute stability of a linear time-invariant system. 
The criterion tests whether any roots of the characteristic equation 
lie in the right half of the s-plane. The number of roots that lie on 
the imaginary axis and in the right half of the s-plane is also indi- 
cated. 

2. Nyquist criterion®: a semigraphical method that gives information 
on the difference between the number of poles and zeros of the 
closed loop transfer function by observing the behavior of the 
Nyquist plot of the loop transfer function. The poles of the closed- 
loop transfer function are the roots of the characteristic equation. 
This method requires that we know the relative location of the zeros 
of the closed-loop transfer function. 

3. Root locus plot (Chapter 8): represents a diagram of loci of the 
characteristic equation roots when a certain system parameter 
varies. When the root loci lie in the right half of the s-plane, the — 
closed-loop system is unstable. 

4. Bode diagram (Appendix A): the Bode plot of the loop transfer 
function G(s)H(s) may be used to determine the stability of the 
closed-loop system. However, the method can be used only if G(s) 
H(s) has no poles and zeros in the right-half s-plane. 

5. Lyapunov’s stability criterion: a method of determining the stability 
of nonlinear systems, although it can also be applied to linear sys- 
tems. The stability of the system is determined by checking on the 
properties of the Lyapunoy function of the system. 


7.5 Routh—Hurwitz Criterion'> 


The Routh-Hurwitz criterion represents a method of determining the location 
of zeros of a polynomial with constant real coefficients with respect to the 
left half and the right half of the s-plane, without actually solving for the 
zeros. The method can be applied to systems with single input and output 
and with multiple inputs and outputs, as well as single- or multiple-loop 
systems. 

Consider that the characteristic equation of a linear time-invariant system 
is of the form 


F(s) == aos" + a,s""! + ays™?2-+....+4,15~-4,=0 (7-24) 


where all the coefficients are real numbers. 
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In order that there be no roots of the last equation with positive real parts, 
it is necessary but not sufficient that* 


1. All the coefficients of the polynomial have the same sign. 
2. None of the coefficients vanishes, 


These two necessary conditions can easily be checked by inspection. How- 
ever, these conditions are not sufficient; it is quite possible that a polynomial 
with all its coefficients nonzero and of the same sign still have zeros in the right 
half of the s-plane. 

The necessary and sufficient condition that all the roots of Eq. (7-24) lie in 
the left half of the s-plane is that the polynomial’s Hurwitz determinants, D,, k 
= 1, 2,...,n, must be all positive. 

The Hurwitz determinants of Eq. (7-24) are given by 


4; @3; as 
a, @3 
D,=a, D,= D;=|a) a, a, 
a az 
0 a, a; 
a, @3; a; zn} 
Qo An a G2n-2 
0 Q@, 43 wee Anns 
D, = 0 ao a, eee Qon-4 (7-25) 
0 0 a, Qirn-s 
0 0 O a, 


where the coefficients with indices larger than n or with negative indices are 
replaced by zeros. 

At first glance the application of the Hurwitz determinants may seem to be 
formidable for high-order polynomials, because of the labor involved in evalua- 
ting the determinants in Eq. (7-25). Fortunately, the rule was simplified by Routh 
into a tabulation, so one does not have to work with the determinants of Eq. 
(7-25). 


* From the basic laws of algebra, the following relations are observed for the polynomial 


in Eq. (7-24): 


— = —£ all roots 

do 

A = = products of the roots taken 2 at a time 
oe = —X products of the roots taken 3 at a time 


= = (—1> products of all roots 


All the ratios must be positive and nonzero unless at least one of the roots has a Positive real 
part. 
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The first step in the simplification of the Routh-Hurwitz criterion is to 
arrange the polynomial coefficients into two rows. The first row consists of the 
first, third, fifth, ... coefficients, and the second row consists of the second, 
the fourth, sixth, . . . coefficients, as shown in the following tabulation: 


Qo a2 a4 ag ag 
a; a3 as az ag 


The next step is to form the following array of numbers by the indicated 
operations (the example shown is for a sixth-order system): 


s6 ao a2 a4 a6 
gS a a3 as 0 
4 a;a2 — Aga; = 4 a1a4 — Anas = B a1ag — ao <0 96 
ai a, at 

Aaz3 —a1B Aas — @\a6 Ax0O-—a; x0 
3 o+ CT 2 i 
s 7 | Cc A D a 0 oO 

BC — AD Cag —A X90 -Ax0 
s2 =p = E Cas Ax =ad6 Exo 74nd =0 0 
st ED — Cae =F 0 ) 0 
50 Fas EXO =4as 0 0 0 


The array of numbers and operations given above is known as the Routh 
tabulation or the Routh array. The column of ss on the left side is used for 
identification purpose. 

Once the Routh tabulation has been completed, the last step in the Routh- 
Hurwitz criterion is to investigate the signs of the numbers in the first column 
of the tabulation. The following conclusions are drawn: The roots of the poly- 
nomial are all in the left half of the s-plane if all the elements of the first column 
of the Routh tabulation are of the same sign. If there are changes of signs in the 
elements of the first column, the number of sign changes indicates the number of 
roots with positive real parts. 

The reason for the foregoing conclusion is simple, based on the require- 
ments on the Hurwitz determinants. The relations between the elements in the 
first column of the Routh tabulation and the Hurwitz determinants are: 


sé Qayg = Ay 
s> a,= D, 
D 

4 a2 

Ss A D, 
D 

3 — 23 

Ss D, 
D 

2 E=2% 

Ss D, 
D 

1 = 5 

Ss D, 
gs? qos 
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Therefore, if all the Hurwitz determinants are positive, the elements in the first 
column would also be of the same sign. 

The following two examples illustrate the application of the Routh—-Hurwitz 
criterion to simple problems. 


EXAMPLE 7-1 Consider the equation 

(s — 2)(s + 1s — 3) = 53 — 452? +4+546=0 (7-26) 
which has two negative coefficients. Thus, from the necessary condition, we know 
without applying the Routh-Hurwitz test that the equation has at least one root with 


positive real parts. But for the purpose of illustrating the Routh-Hurwitz criterion, the 
Routh tabulation is formed as follows: 


53 1 1 
Sign change 
s? —4 6 
Sign change 
(2.5)(6) — (—4)0) __ 
50 og 0 


Since there are two sign changes in the first column of the tabulation, the poly- 
nomial has two roots located in the right half of the 5-plane. This agrees with the known 
result, as Eq. (7-26) clearly shows that the two right-half plane roots are at s = 2 and 
5 = 3. 


EXAMPLE 7-2 Consider the equation 


2s* + 53 + 3524+ 5s +10 =0 (7-27) 


Since the equation has no missing terms and the coefficients are all of the same 
sign, it satisfies the necessary condition for not having roots in the right half of the 
Ss-plane or on the imaginary axis. However, the sufficient condition must still be 
checked. The Routh tabulation is made as follows: 


s¢ 2 3 10 

s3 1 5 0 
Sign change 

52 (DG) > Q)6)_ _ ~7 10 0 
Sign change 

rs) 06) — (1)U0) _ 6.43 0 0 

s? 10 


Since there are two changes in sign in the first column, the equation has two roots 
in the right half of the s-plane. 


Special Cases 


The two illustrative examples given above are designed so that the Routh- 
Hurwitz criterion can be carried out without any complications. However, 
depending upon the equation to be tested, the following difficulties may occur 
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occasionally when carrying out the Routh test: 


1. The first element in any one row of the Routh tabulation is zero, 
but the other elements are not. 
2. The elements in one row of the Routh tabulation are all zero. 


In the first case, if a zero appears in the first position of a row, the elements 
in the next row will all become infinite, and the Routh test breaks down. This 
situation may be corrected by multiplying the equation by the factor (s + a), 
where a is any number,* and then carry on the usual tabulation. 


EXAMPLE 7-3 Consider the equation 
(s — 1)°(s + 2) = 53 —35+2=0 (7-28) 


Since the coefficient of the s? term is zero, we know from the necessary condition 
that at least one root of the equation is located in the right half of the s-plane. To 
determine how many of the roots are in the right-half plane, we carry out the Routh 
tabulation as follows: 


53 1 -—3 
s2 0 2 
sl °° 


Because of the zero in the first element of the second row, the first element of the 
third row is infinite. To correct this situation, we multiply both sides of Eq. (7-28) by 
the factor (s + a), where a is an arbitrary number. The simplest number that enters 
one’s mind is 1. However, for reasons that will become apparent later, we do not 
choose a to be 1 or 2. Let a = 3; then Eq. (7-28) becomes 


(s — 1)*%(s + 2)(s + 3) = 54 + 353 — 352? —-75 +6 =0 (7-29) 
The Routh tabulation of Eq. (7-29) is 


st 1 —3 6 

s3 3 ~—7 0 
Sign change 

@z oo 2 6 0 
Sign change 

0 6 


Since there are two changes in sign in the first column of the Routh tabulation, the 
equation has two roots in the right half of the s-plane. 


As an alternative to the remedy of the situation described above, we may 
replace the zero element in the Routh tabulation by an arbitrary small positive 


*If one chooses to use a negative number for a, the (s + a) term will contribute a root in 
the right half of the s-plane, and this root must be taken into account when interpreting the 
Routh tabulation. 
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number € and then proceed with the Routh test. For instance, for the equation 
given in Eq. (7-28), we may replace the zero element in the second row of the 
Routh tabulation by €; then we have 


s3 1 —3 
s2 € 2 
Sign change 
gl —3e —2 i) 
Sign change € 
sO 2 


Since € is postulated to be a small positive number, (—3¢—2)/e approaches 
—2/e, which is a negative number; thus the first column of the last tabulation 
has two sign changes. This agrees with the result obtained earlier. On the 
other hand, we may assume € to be negative, and we can easily verify that the 
number of sign changes is still two, but they are between the first three rows. 

In the second special case, when all the elements in one row of the Routh 
tabulation are zeros, it indicates that one or more of the following conditions 
may exist: 


I. Pairs of real roots with opposite signs. 

2. Pairs of imaginary roots. 

3. Pairs of complex-conjugate roots forming symmetry about the origin 
of the s-plane. 


The equation that is formed by using the coefficients of the row just above 
the row of zeros is called the auxiliary equation. The order of the auxiliary equa- 
tion is always even, and it indicates the number of root pairs that are equal in 
magnitude but opposite in sign. For instance, if the auxiliary equation is of the 
second order, there are two equal and Opposite roots. For a fourth-order aux- 
iliary equation, there must be two pairs of equal and opposite roots. All these 
roots of equal magnitude can be obtained by solving the auxiliary equation. 

When a row of zeros appear in the Routh tabulation, again the test breaks 
down. The test may be carried on by performing the following remedies: 


1. Take the derivative of the auxiliary equation with respect to s. 

2. Replace the row of zeros with the coefficients of the resultant equa- 
tion obtained by taking the derivative of the auxiliary equation. 

3. Carry on the Routh test in the usual manner with the newly formed 
tabulation. 


Example 7-4 — Consider the same equation, Eq. (7-28), which is used in Example 7-3. 
In multiplying this equation by a factor (s + a), logically the first 
number that comes into one’s mind would be a = 1. Multiplying 
both sides of Eq. (7-28) by (s + 1), we have 


(s — 1%(s + 28 + 2) = 54 +53 ~ 392 —5 +2 =0 (7-30) 
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The Routh tabulation is made as follows: 


s4 1 —3 2 
s3 1] —1 0 
92 ay—3) + ay=) _ > > 
sl i—? =0 0 


Since the s1 row contains all zeros, the Routh test terminates prematurely. The 
difficulty in this case is due to the multiplication of the original equation, which already 
has a root at s = 1, by the factor (s + 1). This makes the new equation fit special case 
(2). To remedy this situation, we form the auxiliary equation using the coefficients 
contained in the s? row, that is, the row preceding the row of zeros. Thus the auxiliary 
equation is written 


A(s) = —257 +2=0 (7-31) 
Taking the derivation of A(s) with respect to s gives 
dA(s) _ _ 
a = —4s (7-32) 


Now, the row of zeros in the Routh tabulation is replaced by the coefficients of Eq. 
(7-32), and the new tabulation reads as follows: 


s4 1 -3 2 
s3 a] —-1 
Sign change 
32 —2 2 (coefficients of auxiliary equations) 
sl —4 0 [coefficients of dA(s)/ds] 
Sign change 
50 2 0 


Since the preceding tabulation has two sign changes, the equation of Eq. (7-28) 
has two roots in the right-half plane. By solving the roots of the auxiliary equation in 
Eq. (7-31), we have 

s2? = 1 or s=+1 

These are also the roots of the equation in Eq. (7-30). It should be remembered 
that the roots of the auxiliary equation are also roots of the original equation, which is 
under the Routh test. 


EXAMPLE 7-5 In this example we shall consider equations with imaginary roots. 
Consider 


(s + 2)(s — 2) + js — js? + 5 + 1) 
= s® + s5 — 254 — 353 — Ts? — 45 ~4=0 (7-33) 


which is known to have two pairs of equal roots with opposite signs at s = +2 and 
s = +j. The Routh tabulation is 


56 1 —2 —7 ~—4 
ss 1 ~3 —4 
s4 1 —3 —4 
s3 0 0 0 
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Since a row of zeros appears prematurely, we form the auxiliary equation using the 
coefficients of the s¢ row. The auxiliary equation is 


A(s) = s* ~— 3527-4 =0 (7-34) 
The derivative of A(s) with respect to s is 
dA(s)__ 403 ge . 
a = 45 6s = 0 (7. 35) 


from which the coefficients 4 and —6 are used to replace the row of zeros in the Routh 
tabulation. The new Routh tabulation is 


56 1 —2 —7 —4 

55 1 —3 —4 

st 1 —3 —4 

daA(s) 

s3 4 —6 0 | coefficients of | 
Sign change 

s2 —1.5 —4 0 

sl —16.7 0 

sO —4 0 


Since there is one change in sign in the first column of the new Routh tabulation, 
Eq. (7-33) has one root in the right half of the s-plane. The equal, but opposite roots 
that caused the all-zero row to occur are solved from the auxiliary equation. From 
Eq. (7-34) these roots are found to be 


s= +2, —2, +j, and —/. 


A frequent use of the Routh-Hurwitz criterion is for a quick check of the 
stability and the simple design of a linear feedback control system. For exam- 
ple, the control system with integral control shown in Fig. 6-29 has the charac- 
teristic equation 

Ss? + 34.5s? + 7500s + 7500K, = 0 (7-36) 


The Routh-Hurwitz criterion may be used to determine the range of K, for 
which the closed-loop system is stable. The Routh tabulation of Eq. (7-36) is 


53 1 7500 
s2 34.5 7500K, 
i 258,750 — 7500K; 
Ry NE: ¥. Ween 0 
34.5 
59 7500.K 1 


For the system to be stable, all the coefficients in the first column of the last 
tabulation should be of the same sign. This leads to the following conditions: 


258,750 — 7500K;, 
ast 0 (7-37) 


7500K, > 0 (7-38) 
From the condition in Eq. (7-37) we have 
K, < 34.5 (7-39) 
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and the condition in Eq. (7-38) gives 


K,>0 (7-40) 
Therefore, the condition for stability is that K, must satisfy 
0<K, < 34.5 (7-41) 


EXxAmpLe 7-6 Consider the characteristic equation of a certain closed-loop control 
system, 
33+ 3Ks? +(K +2)s+4=0 (7-42) 
It is desired to determine the range of K so that the system is stable. The Routh tabula- 
tion of Eq. (7-42) is 


53 1 (K -+ 2) 
s2 3K 4 
3K(K + 2) —4 
1 peda te Da) Maar 
Ss 3K 0 
So 4 


From the s? row, the condition of stability is 
K>0 
and from the s! row, the condition of stability is 
3K? +6K—4>0 or K < —2.528 or K> 0.528 
When the conditions of K > 0 and K > 0.528 are compared, it is apparent that the 
latter limitation is the more stringent one. Thus for the closed-loop system to be stable, 


K must satisfy 
K> 0.528 


The requirement of K < —2.528 is disregarded since K cannot be negative. 


It should be reiterated that the Routh—-Hurwitz criterion is valid only if 
the characteristic equation is algebraic and all the coefficients are real. If any 
one of the coefficients of the characteristic equation is a complex number, or if 
the equation contains exponential functions of s, such as in the case of a system 
with time delays, the Routh—-Hurwitz criterion cannot be applied. 

Another limitation of the Routh-Hurwitz criterion is that it offers infor- 
mation only on the absolute stability of the system. If a system is found to be 
stable by the Routh’s test, one still does not know how good the system is— 
in other words, how closely the roots of the characteristic equation roots are 
located to the imaginary axis of the s-plane. On the other hand, if the system is 
shown to be unstable, the Routh-Hurwitz criterion gives no indication of how 
the system can be stabilized. 


7.6 Nyquist Criterion®!5 


Thus far, two methods of determining stability by investigating the location of 
the roots of the characteristic equation have been indicated: 


1. The roots of the characteristic equation are actually solved. This 
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step can be carried out on a digital computer by means of a root- 
finding subroutine. 

2. The relative location of the roots with respect to the imaginary 
axis of the s-plane is determined by means of the Routh—-Hurwitz 
criterion. 


These two methods are not very useful for design purposes. It is necessary 
to devise stability criteria that will enable the analyst to determine the relative 
stability of the system. It would be desirable if the criterion indicates how the 
stability of the system might be improved. 

The Nyquist criterion possesses the following features that make it desirable 
for the analysis as well as the design of control systems: 


1. It provides the same amount of information on the absolute stability 
of a control system as the Routh-Hurwitz criterion, 

2. In addition to absolute system stability, the Nyquist criterion in- 
dicates the degree of stability of a stable system and gives an indica- 
tion of how the system stability may be improved, if needed. 

3, It gives information on the frequency-domain response of the system. 

4. It can be used for a stability study of systems with time delay. 

5. It can be modified for nonlinear systems. 


We may formulate the Nyquist criterion by first using modern control 
notation, that is, state equations. Let a linear control system with a single input 
be represented by the following set of equations: 


X(t) = Ax(r) + Be(r) (7-43) 
c(t) = Dx(r) (7-44) 
e(t) = r(t) — c(t) (7-45) 


A block diagram that gives the transfer relations of the system is shown 
in Fig. 7-3. This is known as a closed-loop system with unity feedback. The open- 
loop transfer function of the system is defined as 


G(s) = D(sI — A)-'B (7-46) 
When the feedback is nonunity, with the feedback dynamics represented by the 


I+ G(s) >| 


X(s) 


(sI — A)1B 


Fig. 7-3. Block diagram of a closed-loop control system with unity feed- 
back. 
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D(sI — A)-!B C(s) 


Fig. 7-4. Block diagram of a closed-loop control system with unity feed- 
back. 


transfer function H(s), the system block diagram is modified as shown in Fig. 7-4, 
The closed-loop transfer function of the system of Fig. 7-4 is 


C(s) _ G(s) 


R(s) 1+ GS) HG) 
Let the denominator of the closed-loop transfer function be represented 

by F(s). Then 
F(s) = 1 + G(s)A(s) = 1 + Dsl — A)“!BA(s) (7-48) 


It is easy to see that the zeros of F(s) are the roots of the characteristic equation 
of the system, if there is no pole-zero cancellation in G(s)H(s). 

Let us assume that G(s) and H(s) are rational functions; that is, G(s)H(s) 
is a quotient of two polynomials with constant coefficients. In general, F(s) can 
be written 


(7-47) 


_ K(s + z,)(8 + 22)... (2 + Zm) 5 
As: s(s + pis + pr)... (8 + py) See 
where z, (i = i, 2,..., m)and p, (k = 1, 2,..., m) are either real or in complex- 
conjugate pairs. Then the roots of the characteristic equations are s = —z,, 
—Zy,... 5 —Zm. For the closed-loop system to be stable, it is required that none 
of these roots has a positive real part. There is no particular restriction on the 
location of the poles of F(s), which are at s= 0, —p,, —p.,..., —p, It is 
important to note that the poles of F(s) are the same as those of G(s)H(s). If 
any one of the poles of G(s)H(s) lies in the right half of the s-plane, the open- 
loop system is said to be unstable; however, the closed-loop system can still be 
stable, if all the zeros of F(s) are found in the left half of the s-plane. This is a 
very important feature of a feedback control system. In preceding chapters it 
has been pointed out that a high forward-path gain generally reduces the steady- 
state error of a feedback control system. Consequently, it is desirable to use high 
gain in multiple-loop control systems. Although this practice may result in an 
unstable inner-loop system, the entire closed-loop system can be made stable 
by proper design. 
Before embarking on the fundamentals of the Nyquist criterion, it is es- 
sential to summarize on the pole-zero relationships with respect to the system 
functions. 
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. Identification of poles and zeros: 


loop transfer function zeros = zeros of G(s)H(s) 
loop transfer function poles = poles of G(s)H(s) 
closed-loop poles = poles of C(s)/R(s) 

= zeros of F(s) = 1 + G(s)H(s) 

= roots of the characteristic equation 


. The poles of F(s) are the same as the poles of the loop transfer 


function G(s)H(s). 


. For a closed-loop system to be stable, there is no restriction on the 


location of the poles and zeros of the loop transfer function G(s) 
H(s), but the poles of the closed-loop transfer function must all be 
located in the left half of the s-plane. 


“Encircled” versus “Enclosed” 


It is important to distinguish between the concepts encircled and enclosed, 
which are used frequently with the Nyquist criterion. 


Encircled. A point is said to be encircled by a closed path if it is found inside 
the path. For example, point A in Fig. 7-5 is encircled by the closed path I, 
since A is found inside the closed path, whereas point B is not encircled. In 
the application of the Nyquist criterion, the closed path also has a direction 
associated with it. As shown in Fig. 7-5, point A is said to be encircled by 
in the counterclockwise direction. 

When considering all the points inside the closed path, we can say that 
the region inside the closed path I is encircled in the indicated direction. 


eB 


Fig. 7-5. Hlustration of the definition of encirclement. 
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Enclosed. A point or region is said to be enclosed by a closed path if it is 
found to lie to the left of the path when the path is traversed in the prescribed 
direction. Putting it another way, enclosure is equivalent to counterclockwise 
encirclement. For instance, the shaded regions shown in Fig. 7-6(a) and (b) are 
considered to be enclosed by the closed path I. In other words, point A in Fig. 
7-6(a) is enclosed by I, but point A in Fig. 7-6(b) is not. However, in Fig. 7-6(b), 
point B and all the points in the region outside I are considered to be enclosed. 


(a) (b) 


Fig. 7-6. Definition of enclosed points and regions. (a) Point A is enclosed 
by I. (b) Point A is not enclosed but B is enclosed by the locus I. 


Number of encirclement and enclosure. When point 4 is encircled or 
enclosed by a closed path, a number N may be assigned to the number of en- 
circlement or enclosure, as the case may be. The value of V may be determined 
by drawing a vector from A to any arbitrary point s, on the closed path I’ and 
then let s, follow the path in the prescribed direction until it returns to the 
starting point. The total net number of revolutions traversed by this vector is 
N. For example, point A in Fig. 7-7(a) is encircled once by I, and point B is 


Fig. 7-7. Definition of the number of encirclement and enclosure. 
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encircled twice, all in the clockwise direction. Point A in Fig. 7-7(b) is enclosed 
once; point B is enclosed twice. 


Principle of the Argument 


The Nyquist criterion was originated as an engineering application of the 
well-known principle of the argument in complex variable theory. The principle 
is stated as follows, in a heuristic manner. Let F(s) be a single-valued rational 
function that is analytic everywhere in a specific region except at a finite number 
of points in the s-plane. For each point at which F(s) is analytic in the specified 
region in the s-plane, there is a corresponding point in the F(s)-plane. 

Suppose that a continuous closed path IT, is arbitrarily chosen in the s- 
plane, as shown in Fig. 7-8(a). If all the points on I, are in the specified region 


Fig. 7-8. (a) Arbitrarily chosen closed path in the s-plane. (b) Correspond- 
ing locus ly in the F(s)-plane. 


in which F(s) is analytic, then curve T, mapped by the function F(s) into the 
F(s)-plane is also a closed one, as shown in Fig. 7-8(b). If, corresponding to 
point s, in the s-plane, point F(s,) is located in the F(s)-plane, then as the I, 
locus is traversed starting from point s, in the arbitrarily chosen direction 
(clockwise) and then returning to s, after going through all the points on the 
T, locus [as shown in Fig. 7-8(a)], the corresponding I, locus will start from 
point F(s,) and go through points F(s,) and F(s,), which correspond to 5, and 
S3, respectively, and return to the starting point, F(s,). The direction of traverse 
of I’, may be either clockwise or counterclockwise; that is, in the same direction 
or the opposite direction as that of I,, depending on the particular function 
F(s). In Fig. 7-8(b) the direction of I’, is shown, for illustration purposes, to be 
counterclockwise. 

It should be pointed out that, although the mapping from the s-plane to 
the F(s)-plane is one to one for a rational function F(s), the reverse process is 
usually not a one-to-one mapping. For example, consider the function 


K 


MS) = eae ED 


(7-50) 
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which is analytic in the finite s-plane except at the points s = 0, —1, and —2, 
For each value of s in the finite s-plane other than the three points 0, —1, and 
—2, there is only one corresponding point in the F(s)-plane. However, for each 
point in the F(s)-plane, the function maps into three corresponding points in 
the s-plane. The simplest way to illustrate this is to write Eq. (7-50) as 
K 

F(s) 

The left side of Eq. (7-51) is a third-order equation, which has three roots when 
F(s) is chosen to be a constant. 

The principle of the argument can be stated: Let F(s) be a single-valued 
rational function that is analytic in a given region in the s-plane except at a finite 
number of points. Suppose that an arbitrary closed pathT,, is chosen in the s-plane 
so that F(s) is analytic at every point on T,; the corresponding F(s) locus mapped 
in the F(s)-plane will encircle the origin as many times as the difference between 
the number of the zeros and the number of poles of F(s) that are encircled by 
the s-plane locus T,. 

In equation form, this statement can be expressed as 


N=Z—P (7-52) 


s(s + Is +2) = (7-51) 


where 


N = number of encirclement of the origin made by the F(s)-plane 
locus I’, 


Z = number of zeros of F(s) encircled by the s-plane locusT, in the 
s-plane 


P = number of poles of F(s) encircled by the s-plane locusT, in the 
s-plane 


In general, V can be positive (Z > P), zero (Z = P), or negative (Z < P). 
These three situations will now be described. 


1. N>0(Z > P). If the s-plane locus encircles more zeros than poles 
of F(s) in a certain prescribed direction (clockwise or counterclock- 
wise), N is a positive integer. In this case the F(s)-plane locus will 
encircle the origin of the F(s)-plane N times in the same direction 
as that of T,. 

2. N=0(Z = P). If the s-plane locus encircles as many poles as zeros, 
or no poles and zeros, of F(s), the F(s)-plane locus T’; will not encircle 
the origin of the F(s)-plane. 

3. N<0(Z < P). If the s-plane locus encircles more poles than zeros 
of F(s) in a certain direction, N is a negative integer. In this case the 
F(s)-plane locus, I’,, will encircle the origin N times in the opposite 
direction from that of T,. 


A convenient way of determining N with respect to the origin (or any other 
point) of the F(s) plane is to draw a line from the point in any direction to 
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F(s)-plane F(s)-plane 


F(s)-plane 


Fig. 7-9. Examples of the determination of N in the F(s)-plane. 


infinity; the number of net intersections of this line with the F(s) locus gives the 
magnitude of N. Figure 7-9 gives several examples of this method of determining 
N. It is assumed that the ’, locus has a counterclockwise sense. 

A rigorous proof of the principle of the argument is not given here. The 
following illustration may be considered as a heuristic explanation of the prin- 
ciple. Let us consider the function F(s) given by 


K(s + 2) 
Fs) = ————“"_~ 7-53 
(s) (s + pil(s + p2) ( ) 
where K is a positive number. The poles and zero of F(s) are assumed to be as 
shown in Fig. 7-10(a). 

The function F(s) can be written 


F(s) = | Fs) |/FCs) 


_ Kista] _ 7 (7-54) 
= Tee, |S ep a ep) 
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s-plane 


(a) 


jimF 
F(s)-plane 


F(s,) 


Re F 


(b) 


Fig. 7-10. (a) Pole-zero configuration of F(s) in Eq. (7-53) and the s-plane 
trajectory T’;. (b) F(s)-plane locus, 'y, which corresponds to the I’, locus 
of (a) through the mapping of Eq. (7-53). 


Figure 7-10(a) shows an arbitrarily chosen trajectory I’, in the s-plane, 
with the arbitrary point s, on the path. The function F(s) evaluated at s = 5, 
is given by 

as K(s, + 21) 
Foss) (81 + pi(S1 + Pa) eee) 

The factor s, + z, can be represented graphically by the vector drawn 
from —z, to s,. Similar vectors can be defined for (s, + p,) and (s, + p,). 
Thus F(s,) is represented by the vectors drawn from the given poles and zcro 
to the point s,, as shown in Fig. 7-10(a). Now, if the point s. moves along the 
locus [’, in the prescribed counterclockwise direction until it returns to the 
starting point, the angles generated by the vectors drawn from the poles (and 
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zeros if there were any) that are not encircled by I, when s, completes one 
round trip are zero; whereas the vector (s, + z,) drawn from the zero at —z,, 
which is encircled by I,, generates a positive angle (counterclockwise sense) 
of 2 rad. Then, in Eq. (7-54), the net angle or argument of F(s) as the point 
s, travels around I, once is equal to 27, which means that the corresponding 
F(s) plot must go around the origin 2z radians or one revolution in a counter- 
clockwise direction, as shown in Fig. 7-10(b). This is why only the poles and 
zeros of F(s), which are inside the I’, path in the s-plane, would contribute to 
the value of N of Eq. (7-52). Since poles of F(s) correspond to negative phase 
angles and zeros correspond to positive phase angles, the value of N depends 
only on the difference between Z and P. 
In the present case, 


Thus 

N=Z—P=1 
which means that the F(s)-plane locus should encircle the origin once in the same 
direction as the s-plane locus. It should be kept in mind that Z and P refer only 
to the zeros and poles, respectively, of F(s) that are encircled by I, and not the 
total number of zeros and poles of F(s). 

In general, if there are N more zeros than poles of F(s), which are encircled 
by the s-plane locus I, in a prescribed direction, the net angle traversed by the 
F(s)-plane locus as the s-plane locus is traversed once is equal to 

2n(Z — P) = 2nN (7-56) 
This equation implies that the F(s)-plane locus will encircle the origin N times 
in the same direction as that of ,. Conversely, if N more poles than zeros are 
encircled by I,, in a given prescribed direction, N in Eq. (7-56) will be negative, 
and the F(s)-plane locus must encircle the origin N times in the opposite direction 
to that of T,. 

A summary of all the possible outcomes of the principle of the argument 
is given in Table 7-1. 


Table 7-1 Summary of All Possible Outcomes of the 
Principle of the Argument 


F(s)-Plane Locus 
Sense of the Number of Encirclements Direction of 
N=Z-P s-Plane Locus of the Origin Encirclement 
N>0O Clockwise N ‘Clockwise 
Counterclockwise Counterclockwise 
N<0 Clockwise N Counterclockwise 
Counterclockwise Clockwise 
ae en ee 
N=0 Clockwise 0 No encirclement 
Counterclockwise No encirclement 


ot ar 
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Nyquist Path 


At this point the reader should place himself in the position of Nyquist 
many years ago, confronted with the problem of determining whether or not 
the rational function 1 + G(s)H(s) has zeros in the right half of the s-plane. 
Apparently, Nyquist discovered that the principle of the argument could be 
used to solve the stability problems, if the s-plane locus, IT’,, is taken to be one 
that encircles the entire right half of the s-plane. Of course, as an alternative, 
I’, can be chosen to encircle the entire left-half s-plane, as the solution is a 
relative one. Figure 7-11 illustrates a I’, locus, with a counterclockwise sense, 
which encircles the entire right half of the s-plane. This path is often called the 
Nyquist path. 

Since the Nyquist path must not pass through any singularity of F(s), 
the small semicircles shown along the j@ axis in Fig. 7-11 are used to indicate 
that the path should go around these singular points of F(s). It is apparent that 

8 


Poles of 
F(s) 


— jee 


Fig. 7-11. Nyquist path. 


Sec. 7.6 Nyquist Criterion / 341 


if any pole or zero of F(s) lies inside the right half of the s-plane, it will be 
encircled by this Nyquist path. 

For the convenience of analysis, the Nyquist path is divided into a mini- 
mum of three sections. The exact number of sections depends upon how many 
of those small semicircles are necessary on the imaginary axis. For the situation 
illustrated in Fig. 7-11, a total of eight sections needs to be defined. The order 
of numbering these sections is entirely arbitrary. The notations jw{, ji, +/0*, 
—j0*, —jwj, and —/jqj are used to identify the starting and ending points of 
the small semicircles only. 


Section 1: from s = +joo to + j@j along the jw axis. 

Section 2: from +jm@? to +j/q@jz along the small semicircle around 
S=J@,. 

Section 3: from s = j@; to +/0* along the jq@ axis. 

Section 4: from +/0* to —j0* along the small semicircle around s = 0 


Section 5: from s = —j0* to —jq@j; along the jq@ axis (mirror image 
of section 3). 

Section 6: from s = —j@jz to —jm{ along the semicircle around 
S = —jq@, (mirror image of section 2). 

Section 7: from s = —j@{ to s = —joo along the jw axis (mirror 
image of section 1). 

Section 8: from s = —joo to s=-+joo along the semicircle of 


infinite radius. 


Nyquist Criterion and the G(s)H(s) Plot 


The Nyquist criterion is a direct application of the principle of the argument 
when the s-plane locus is the Nyquist path. In principle, once the Nyquist path 
is specified, the stability of a closed-loop system can be determined by plotting 
the F(s) = 1 + G(s)H(s) locus when s takes on values along the Nyquist path, 
and investigating the behavior of the F(s) plot with respect to the origin of the 
F(s)-plane. This is called the Nyquist plot of F(s). However, since usually the 
function G(s)H(s) is given, a simpler approach is to construct the Nyquist 
plot of G(s)H(s), and the same result of F(s) can be determined from the be- 
havior of the G(s)H(s) plot with respect to the (—1, 0) point in the G(s)A(s)- 
plane. This is because the origin of the F(s)-plane corresponds to the (—1, j0) 
point (or the —1 point on the real axis) of the G(s)A(s)-plane. In addition, if 
the location of the poles of G(s)H(s) is not known, the stability of the open-loop 
system can be determined by investigating the behavior of the Nyquist plot of 
G(s)H(s) with respect to the origin of the G(s)H(s)-plane. 

Let us define the origin of the G(s)H(s)-plane or the origin of the 1 + 
G(s)H(s)-plane, as the problem requires, as the critical point. We are inter- 
ested basically in two types of stability: stability of the open-loop system, and 
stability of the closed-loop system. 

It is important to clarify that closed-loop stability implies that 1 + G(s) 
H(s) has zeros only in the left half of the s-plane. Open-loop stability implies 
that G(s)H(s) has poles only in the left half of the s-plane. 
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With this added dimension to the stability problem, it is necessary to define 
two sets of N, Z, and P, as follows: 


N, = number of encirclements of the origin made by G(s)H(s) 


Z») = number of zeros of G(s)H(s) that are encircled by the 
Nyquist path, or in the right half of the s-plane 


P, = number of poles of G(s)H(s) that are encircled by the 
Nyquist path, or in the right half of the s-plane 


N_, = number of encirclements of the (—1, /0) point made by G(s)H(s) 


Z_, = number of zeros of 1 + G(s)A(s) that are encircled by the 
Nyquist path, or in the right half of the s-plane 


P_, = number of poles of G(s)H(s) that are encircled by the 
Nyquist path, or in the right half of the s-plane 


Several facts become clear and should be remembered at this point: 
Pi=P_; (7-57) 


since G(s)H(s) and 1 + G(s)H(s) always have the same poles. Closed-loop 
stability implies or requires that 


Z_,=—0 (7-58) 
but open-loop stability requires that 
P, =0 (7-59) 


The crux of the matter is that closed-loop stability is determined by the 
properties of the Nyquist plot of the open-loop transfer function G(s)H(s). 

The procedure of applying the principle of the argument for stability studies 
is summarized as follows: 


1. Given the control system, which is represented by the closed-loop 
transfer function of Eq. (7-47), the Nyquist path is defined according 
to the pole-zero properties of G(s)H(s). 

2. The Nyquist plot of G(s)H(s) is constructed. 

3. The values of N, and N_, are determined by observing the behavior 
of the Nyquist plot of G(s)H(s) with respect to the origin and the 
(—1,/0) point, respectively. 

4. Once N, and N_, are determined, the value of P, (if it is not already 
known) is determined from 


No = Zo — Po (7-60) 
if Z) is given. Once P, is determined, P_, = P, [Eq. (7-57)], and 
Z_, is determined from 

N_,=Z_,—P_,; (7-61) 


Since it has been established that for a stable closed-loop system Z_, must 
be zero, Eq. (7-61) gives 
N_,=-—P., (7-62) 
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Therefore, the Nyquist criterion may be formally stated: For a closed- 
loop system to be stable, the Nyquist plot of G(s)H(s) must encircle the (—1, j0) 
point as many times as the number of poles of G(s)H(s) that are in the right half of 
the s-plane, and the encirclement, if any, must be made in the clockwise direction. 

In general, it is not always necessary to construct the Nyquist plot which 
corresponds to the entire Nyquist path. In fact, a great majority of the practical 
problems can be solved simply by sketching the part of G(s)H(s) that corresponds 
to the +-j@-axis of the s-plane. The condition when this simplified procedure is 
possible is when P, = P_, = 0; that is, G(s)H(s) has no poles in the right half 
of the s-plane. In this case Eq. (7-61) becomes 


NL, = Z., (7-63) 


which means that the Nyquist plot of G(s)H(s) can encircle the (—1, /0) point 
only in the counterclockwise direction, since N_, in Eq. (7-63) can only be zero 
or positive. Since counterclockwise encirclement is equivalent to enclosure, we 
can determine closed-loop stability by checking whether the (—1, /0) critical 
point is enclosed by the G(s)H(s) plot. Furthermore, if we are interested only in 
whether N_, is zero, we need not sketch the entire Nyquist plot for G(s)H(s), 
only the portion from s = +/joo to s=0 along the imaginary axis of the 
s-plane. 

The Nyquist criterion for the P_, = 0 case may be stated: If the function 
G(s)H(s) has no poles in the right half of the s-plane, for the closed-loop system to 
be stable, the Nyquist plot of G(s)H(s) must not enclose the critical point (—1, j0). 

Furthermore, if we are not interested in the number of roots of the char- 
acteristic equation that are in the right-half plane, but only the closed-loop 
stability, only the G(s)H(s) plot that corresponds to the positive imaginary axis 
of the s-plane is necessary. Figure 7-12 illustrates how the s = jo to s=0 


ilmGH 


G(s)H(s)-plane 


Re GH 
a | 


Not 
enclosed 


Enclosed 
region 


Fig. 7-12. Nyquist plot of G(s)H(s), which corresponds tos = jw tos = 0, 
to indicate whether the critical point is enclosed, 
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portion of the Nyquist plot may be used to determine whether the critical point 
at (—1, 70) is enclosed. 


7.7 Application of the Nyquist Criterion 


The following examples serve to illustrate the practical application of the Nyquist 
criterion to the stability of control systems. 


EXAMPLE 7-7 Consider a single-loop feedback control system with the loop transfer 
function given by 


G(s)H(s) == (7-64) 


K 
s(s + a) 
where K and a are positive constants. It is apparent that G(s)H(s) does not have any 
pole in the right-half s-plane; thus, Py) = P_, = 0. To determine the stability of the 
closed-loop system, it is necessary only to sketch the Nyquist plot of G(s)H(s) that 
corresponds to s = joo to s = 0 on the Nyquist path and see if it encloses the (—1, /0) 
point in the G(s)H(s)-plane. However, for the sake of illustration, we shall construct 
the entire G(s)H(s) plot for this problem. 

The Nyquist path necessary for the function of Eq. (7-64) is shown in Fig. 7-13. 


— joo 


Fig. 7-13. Nyquist path for the system in Example 7-7. 


Since G(s)H(s) has a pole at the origin, it is necessary that the Nyquist path includes a 
small semicircle around s = 0. The entire Nyquist path is divided into four sections, as 
shown in Fig. 7-13. 

Section 2 of the Nyquist path is magnified as shown in Fig. 7-14(a). The points on 
this section may be represented by the phasor 


5 = €e/? (7-65) 


where €(€ —» 0) and @ denote the magnitude and phase of the phasor, respectively. 
As the Nyquist path is traversed from 4-/0* to —/0* along section 2, the phasor of 
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jw jim GH G(s)H(s)-plane 
s-plane 3 F 
aa 180° counterclockwise 
tio rotation 
Ss 180° 
clockwise 


rotation 
Re GH 


(a) 


Fig. 7-14. (a) Section 2 of the Nyquist path of Fig. 7-13. (b) Nyquist plot of 
G(s)H(s) that corresponds to section 2. 


Eq. (7-65) rotates in the clockwise direction through 180°. Also, in going from +-j0* 
to —j0*, 6 varies from +90° to —90° through 0°. The corresponding Nyquist plot of 
G(s)H(s) can be determined simply by substituting Eq. (7-65) into Eq. (7-64). Thus 


K 
G(s)H(s) oe = €e%(Eel? + a) (7-66) 
Since € — 0, the last expression is simplified to 
Ce)a s= 6030 = aeelo coe? (7-67) 


which indicates that all points on the Nyquist plot of G(s)H(s) that correspond to 
section 2 of the Nyquist path have an infinite magnitude, and the corresponding phase 
is opposite that of the s-plane locus. Since the phase of the Nyquist path varies from 
+90° to —90° in the clockwise direction, the minus sign in the phase relation of Eq. 
(7-67) indicates that the corresponding G(s)H(s) plot should have a phase that varies 
from —90° to +90° in the counterclockwise direction, as shown in Fig. 7-14(b). 

In general, when one has acquired proficiency in the sketching of the Nyquist 
plots, the determination of the behavior of G(s)H(s) at s = 0 and s = co may be 
carried out by inspection. For instance, in the present problem the behavior of G(s)H(s) 
corresponding to section 2 of the Nyquist path is determined from 


F ‘i K _ K 
me CONG) = OD ae a) 2 sa ee 
From this equation it is clear that the behavior of G(s)H(s) at s = 0 is inversely propor- 
tional to s. As the Nyquist path is traversed by a phasor with infinitesimally small 
magnitude, from +/0* to —j0* through a clockwise rotation of 180°, the corresponding 
G(s)H(s) plot is traced out by a phasor with an infinite magnitude, 180° in the opposite 
or counterclockwise direction. It can be concluded that, in general, if the limit of 


346 / Stability of Control Systems Chap. 7 


G(s)H(s) as s approaches zero assumes the form 
lim G(s)H(s) = lim Ks*" (7-69) 
s70 sO 


the Nyquist plot of G(s)H(s) that corresponds to section 2 of Fig. 7-14(a) is traced out 
by a phasor of infinitesimally small magnitude n x 180 degrees in the clockwise 
direction if the plus sign is used, and by a phasor of infinite magnitude m x 180° in the 
counterclockwise direction if the negative sign is used. 

The technique described above may also be used to determine the behavior of the 
G(s)H(s) plot, which corresponds to the semicircle with infinite radius on the Nyquist 
path. The large semicircle referred to as section 4 in Fig. 7-13 is isolated, as shown in 
Fig. 7-15(a). The points on the semicircle may be represented by the phasor 


s = Reit (7-70) 


Jw 


$s-plane 


s = Re/o 


180° 
counterclockwise 


rotation 


jim GH G(s)H(s)-plane 


360° clockwise 
\ rotation 


ReG 


Radius > 0 
(b) 

= joo 

Fig. 7-15. (a) Section 4 of the Nyquist path of Fig. 7-13. (b) Nyquist plot 

of G(s)H(s) that corresponds to section 4. 
where R — oo. Substituting Eq. (7-70) into Eq. (7-64) yields 

K 
= ~—— | = 0e-/2e rz 
G(s)H(s) ered Riel Oe (7-71) 


which implies that the behavior of the G(s)H(s) plot at infinite frequency is described by 
a phasor with infinitesimally small magnitude which rotates around the origin 2 x 180° 
= 360° in the clockwise direction. Thus the G(s)H(s) plot that corresponds to section 
4 of the Nyquist path is sketched as shown in Fig. 7-15(b). 

Now to complete the Nyquist plot of the transfer function of Eq. (7-64) we must 
consider sections 1 and 3. Section 1 is usually constructed by substituting s = j@ into 
Eg. (7-64) and solving for the possible crossing points on the real axis of the G(s)H(s)- 
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plane. Equation (7-64) becomes 
G(j@)H(j@) = ——* 


jeotjan +a) oo 


which is rationalized by multiplying the numerator and denominator by the complex 
conjugate of the denominator. Thus 
K(-—@? — jaw) 


GUa)Hja) = SSO SS 


(7-73) 
The intersect of G(j@)H(j@) on the real axis is determined by equating the imaginary 
part of G(j@) H(j@) to zero. Thus the frequency at which G(j@)H (jo) intersects the 
real axis is found from 

— Kaw —Ka 


Im Gj@)H(J0) = iF gag = aa? + a) = 


0 (7-74) 
which gives @ = co. This means that the only intersect on the real axis in the G(s)H(s)- 
plane is at the origin with @ = co. Since the Nyquist criterion is not concerned with 
the exact shape of the G(s)H(s) locus but only the number of encirclements, it is not 
necessary to obtain an exact plot of the locus. The complete Nyquist plot of the function 
of Eq. (7-64) is now sketched in Fig. 7-16 by connecting the terminal points of the loci 


jIm GH 


G(s)H(s)-plane 


Area 
énclosed by 
G(s)H(s) 


Fig. 7-16. Complete Nyquist plot of G(s)H(s) = K/{s(s + a)]. 
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that correspond to sections 2 and 4, without intersecting any finite part of the real 
axis. 

It is of interest to check all the pertinent data that can be obtained from the 
Nyquist plot of Fig. 7-16. First, No = N_, = 0. By inspection of Eq. (7-64), Z) = 0 
and P, = 0, which satisfy Eq. (7-60). Since Py) = P_;, Eq. (7-61) leads to 


Z-1=N1+P.,=0 (7-75) 


Therefore, the closed-loop system is stable. This solution should have been anticipated, 
since for the second-order system, the characteristic equation is simply 


sitas+ K=0 (7-76) 


whose roots will always lie in the left half of the s-plane for positive a and K. 

Figure 7-16 also shows that for this problem it is necessary only to sketch the 
portion of G(s)H(s) that corresponds to section 1 of the Nyquist path. It is apparent 
that the (—1,/0) point will never be enclosed by the G(s)H(s) plot for all positive 
values of K. 


EXAMPLE 7-8 Consider that a control system with single feedback loop has the loop 
transfer function 
Gi) Hy) = 6D 


The characteristic equation of the system is 
s?+(14+ K)s—-K=0 (7-78) 


which has one root in the right half of the s-plane for all positive K. The Nyquist path 
of Fig. 7-13 is applicable to this case. 
Section 2, s = €e/?: 


lim G(s)H(s) = lim A = cog stn) (7-79) 
s70 s>0 


This means that the Nyquist plot of G(s)H(s) which corresponds to section 2 of the 
Nyquist path is traced by a phasor with infinite magnitude. This phasor starts at an 
angle of +-90° and ends at —90° and goes around the origin of the G(s)H(s)-plane 
counterclockwise a total of 180°. 

Section 4. s = Reit: 


lim G(s)H(s) = lim * = 0e-/# (7-80) 
Thus the Nyquist plot of G(s)H(s) corresponding to section 4 of the Nyquist path goes 


around the origin 180° in the clockwise direction with zero magnitude. 
Section! s =jQ@: 


K(ijo—1)  KUj@ —1)(—@? —j/@) _ ,2@ 4-j(1 — w?) 


GU@)HU®) = Foxjea F 1) — at + @? A O@? +1) 
(7-81) 
Setting the imaginary part of G(j@)H(j@) to zero, we have 
@ = -++1 rad/sec (7-82) 


which are frequencies at which the G(j@)H(j@) locus crosses the real axis. Then 
GUYAG1) = K (7-83) 
Based on the information gathered in the last three steps, the complete Nyquist 
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jim GH 


G(s)A(s) — plane 


Fig. 7-17. Complete Nyquist plot of G(s)H(s) = K(s — 1)/[s(s + DJ. 


plot of G(s)H(s) is sketched as shown in Fig. 7-17. We can conclude that, by inspection, 
Z= 
Py =P_; =0 
Figure 7-17 indicates that No = 1, which is in agreement with the Nyquist criterion. 
Figure 7-17 also gives N_; = 1. Then 
Z-1)=N1+P.1=1 (7-84) 


which means that the closed-loop system is unstable, since the characteristic equation 
has one root in the right half of the s-plane. The Nyquist plot of Fig. 7-17 further 
indicates that the system cannot be stabilized by changing only the value of K. 


EXAMPLE 7-9 Consider the control system shown in Fig. 7-18. It is desired to deter- 
mine the range of K for which the system is stable. The open-loop 
transfer function of the system is 


C(s) __ _ _10K(s + 2) 
E(s) = G(s) = =? 4 352 + 10 ae 352 ae 10 (7-85) 


Since this function does not have any pole or zero on the j@ axis, the Nyquist path 
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Fig. 7-18. Block diagram of the control system for Example 7-9. 


Fig. 7-19. Nyquist path for the transfer function of Eq. (7-85). 


can consist of only three sections, as shown in Fig. 7-19. The construction of the 
Nyquist plot of G(s) is outlined as follows: 
Section 4. s = Rel: 

tim G(s) = 49K = 06-14 (7-86) 
As the phasor for section 4 of the Nyquist path is traversed from —90° to +90° 
through 180° counterclockwise, Eq. (7-86) indicates that the corresponding Nyquist 
plot of G(s) is traced by a phasor of practically zero length from +180° to —180° 
through a total of 360° in the clockwise sense. 


Section]. s =j@: 
10K(j@ + 2) 


GU®) = G9 — 30) — jo? (7-87) 


Rationalizing, the last equation becomes 


10K[2010 — 3@?) —@* + j@(l0 — 37) + j2@3) 
(10 — 32)? + wé 


G(j@) = (7-88) 
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Setting the imaginary part of G(j@) to zero gives 
@ = 0 rad/sec 


@ = +./10 rad/sec 


which correspond to the frequencies at the intersects on the real axis of the G(s)-plane. 
In this case it is necessary to determine the intersect of the G(s) plot on the imaginary 
axis, Setting the real part of G(j@) to zero in Eq. (7-88), we have 


w* + 6m? — 20 = 0 (7-89) 


and 


which gives 
© = +1.54 rad/sec 
Therefore, the intersects on the real axis of the G(s)-plane are at 


G(j0) = 2K 
and 
G(j./10) = —K 


and the intersect on the imaginary axis is 


Gj./2) =j10./2 K/3 
With the information gathered in the preceding steps, the Nyquist plot for G(s) 
of Eq. (7-85) is sketched as shown in Fig. 7-20. The information on the imaginary axis 
is needed so that the direction of section 1 may be determined without actually plotting 
the locus point by point. 


jImG 


G(s)-plane 


Fig. 7-20. Nyquist plot of G(s) = 10K(s + 2)/(s3 + 352 4 10). 
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Inspection of the Nyquist plot of Fig. 7-20 reveals that No = —2. Since Eq. 
(7-85) shows that G(s) has no zeros inside the right half of the s-plane, Z) = 0; this 
means that Py = 2. Thus P_; = 2. Now, applying the Nyquist criterion, we have 

Ny =Z_4 —P.y =Z., —2 (7-90) 
Thus for the closed-loop system to be stable, Z_, = 0, which requires that N., = —2. 
With reference to Fig. 7-20, the stability criterion requires that the (—1, 70) point must 
be encircled twice in the clockwise direction. In other words, the critical point should 
be to the right of the crossover point at —K. Thus, for stability, 


K>1 (7-91) 


The reader can easily verify this solution by applying the Routh—Hurwitz criterion 
to the characteristic equation of the system. 


It should be reiterated that although the Routh—Hurwitz criterion is much 
simpler to use in stability problems such as the one stated in this illustrative 
example, in general the Nyquist criterion leads to a more versatile solution, 
which also includes information on the relative stability of the system. 


7.8 Effects of Additional Poles and Zeros of G(s)H(s) on the 
Shape of the Nyquist Locus 


Since the performance and the stability of a feedback control system are often 
influenced by adding and moving poles and zeros of the transfer functions, it 
is informative to illustrate how the Nyquist locus is affected when poles and zeros 
are added to a typical loop transfer function G(s)H(s). This investigation will also 
be helpful to gain further insight on the quick sketch of the Nyquist locus of a 
given function. 

Let us begin with a first-order transfer function 


K 


G()H(s) = oF T, (7-92) 
The Nyquist locus of G(j@)H(ja) for 0 << @ < co is a semicircle, as shown 
in Fig. 7-21. 
jImGH 


G(s)A(s)-plane 


Fig. 7-21. Nyquist plot of G(s)H(s) = K/(1 + 715). 
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Addition of poles at s = 0. Consider that a pole at s = 0 is added to the 
transfer function of Eq. (7-92); then we have 


G(s)H(s) = (7-93) 


K 
s(l + sT) 
The effect of adding this pole is that the phase of G(iw)H(ja) is reduced by 
—90° at both zero and infinite frequencies. 

In other words, the Nyquist locus of G(jw)H(ja) is rotated by —90° from 
that of Fig. 7-21 at @ = 0 and w = ©, as shown in Fig. 7-22. In addition, the 


jlm GH 


G(s)A(s)-plane 


Re GH 


Fig. 7-22. Nyquist locus of G(s)H(s) = K/[s(1 + 7;s)]. 


magnitude of G(jw)H(ja) at w = 0 becomes infinite. In general, adding a pole 
of multiplicity j at s = 0 to the transfer function of Eq. (7-92) will give the fol- 
lowing properties to the Nyquist locus of G(s)H(s): 


lim (G(jo)H(ja) = —(j + 1) > (7-94) 
lim /G(jo)H(ja) = —j (7-95) 
lim |G(joo)H(joo) | = 0 (7-96) 
tim |G(ja)H(ja)| = (7-97) 


Figure 7-23 illustrates the Nyquist plots of 


G(s)H(s) = APTS (7-98) 


and 


a 
In view of these illustrations it is apparent that addition of poles at s = 0 
will affect the stability adversely, and systems with a loop transfer function of 


more than one pole at s = 0 are likely to be unstable. 
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Fig. 7-23. Nyquist loci for (1) G(s)H(s) = K/{s2(1 + T15)]. (2) G(s)H(s) = 
K/{se(. + T15)]. 


Addition of finite poles. When a pole at s = —1/T, is added to the G(s) 
H(s) function of Eq. (7-92), we have 
G(s)H(s) = x 


(1 + T,s)(1 + T,s) 


The Nyquist locus of G(s)H(s) at m = 0 is not affected by the addition of the 
pole, since 


(7-100) 


lim G(jw)H(jo) = K (7-101) 
The Nyquist locus at @ = ©¢ is 
lim G( joo) H(jo) = lim pop = [= 180" (7-102) 
jim GH G(s)H(s)-plane 


Re GH 


Fig. 7-24. Nyquist loci for (1) G(s)H(s) = K/[1 + Tis)(1 + Tas]. (2) 
G(s)H(s) = K/[G + Tis) + Tes) + T3)). 
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Thus the effect of adding a pole at s == —1/T, to the transfer function of 
Eq. (7-92) is to shift the phase of the Nyquist locus by —90° at infinite fre- 
quency, as shown in Fig. 7-24. This figure also shows the Nyquist locus of 


K 
(1 + T,s)U + T,5)1 + Ts) 


These examples show the adverse effects on stability that result from the 
addition of poles to the loop transfer function. 


G(s)H(s) = (7-103) 


Addition of zeros. It was pointed out in Chapter 6 that the effect of the 
derivative control on a closed-loop control system is to make the system more 
stable. In terms of the Nyquist plot, this stabilization effect is easily shown, 
since the multiplication of the factor (1 + 7,s) to the loop transfer function 
increases the phase of G(s)H(s) by 90° at @ = oo. 

Consider that the loop transfer function of a closed-loop system is given 
by 

K 
s(l + T,s)Q1 + T,5) 


It can be shown that the closed-loop system is stable for 0 << K < (T, + T. 2)! 
T,T,. Suppose that a zero at s = —1/T, is added to the transfer function of Eq. 
(7-104), such as with a derivative control. Then 


G(s)H(s) = (7-104) 


re KC. + 7,s) 
OH) = Ty To) xe 


The Nyquist loci of the two transfer functions of Eqs. (7-104) and (7-105) 
are sketched as shown in Fig. 7-25. The effect of the zero in Eq. (7-105) is to add 


j lm GH 
G(s)H(s)-plane 


T,T, 
K(T, + T2) 


Fig. 7-25. Nyquist loci for (1) G(s)H(s) = K/{s. + Ts) + 72s)}. (2) 
G(s)H(s) = K( + Tas)/[s(1 + Tis) + T25)]. 
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90° to the phase of G(jw)H(jm) at @ = co while not affecting the locus at @ = 0. 
The crossover point on the real axis is moved from —K(T, + T,)/T,T, to 
—K(T, + T,)/T,T,(1 + T,), which is closer to the origin of the G(j@)H(ia)- 
plane. 


7.9 Stability of Multiloop Systems 


The stability analyses conducted in the preceding sections are all centered 
toward systems with a single feedback loop, with the exception of the Routh- 
Hurwitz criterion, which apparently can be applied to systems of any con- 
figuration, as long as the characteristic equation is known. We shall now illus- 
trate how the Nyquist criterion is applied to a linear system with multiple feed- 
back loops. 

In principle, all feedback systems with single input and output can be 
reduced to the basic system configuration of Fig. 7-4. Then it would seem that 
the Nyquist criterion can be applied in a straightforward manner to the equiva- 
lent loop transfer function G(s)H(s). However, owing to the multiloop nature 
of the original system, the poles and/or the zeros of G(s)H(s) may be unknown, 
and a systematic approach to the problem may be adopted. 

Let us illustrate the procedure of applying Nyquist criterion to a multiloop 
control system by means of a specific example. Figure 7-26 gives the block 
diagram of a control system with two loops. The transfer function of each 
block is indicated in the diagram. In this case it is simple to derive the open- 
loop transfer function of the system as 


C(s) _ — _G,(s)G2(5) 
Es) ~ °° = TE G,QH@ dies 
K(s +2) 


~ + 10s + DS +2) + SI 
The stability of the overall system can be investigated by sketching the Nyquist 


_ Ks +2) _ 
rae 10) G2 (5) = 


1 
s(s + 1)(s +2) 


Fig. 7-26. Multiloop feedback control system. 
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locus of G(s), except that the poles of G(s) are not entirely known. To avoid 
the construction of the entire Nyquist locus of G(s), we can attack the problem 
in two stages, as there are two feedback loops. First, consider only the inner 
loop, whose loop transfer function is G,(s)H(s). We shall first sketch the Nyquist 
locus of G,(s)H(s) for 0 < @ < co. The property of the G,(s)H(s) plot with 
respect to the (—1, /0) point gives an indication of the number of zeros of 1 + 
G,(s)H(s) that are in the right half of the s-plane. Having found this information, 
we then proceed to sketch the Nyquist locus of G(s) of Eq. (7-106) only for 0 < 
@ < oo to determine the stability of the overall system. 
Figure 7-27 shows the Nyquist locus of 


5 


GADHE) = TED 


(7-107) 


jImG,H 


G2 (s)H(s)-plane 


Re G)H 


Fig. 7-27. Nyquist plot of G2(s)H(s) = 5/[s(s + 1)(s + 2)}. 


Since the (—1, /0) point is not enclosed by the locus, the inner loop is stable by 
itself, and the zeros of 1 + G,(s)H(s) are all in the left half of the s-plane. Next, 
the Nyquist locus of G(s) of Eq. (7-106) is sketched as shown in Fig. 7-28. Since 
all the poles and zeros of G(s) are found to be in the left half of the s-plane, we 
only have to investigate the crossover point of the G(s) locus with respect to the 
(—1,j0) point to determine the requirement on K for the overall system to be 
stable. In this case the range of K for stability is 0 << K < 50. 

Now, let us consider a system that is a slightly modified version of Fig. 
7-26. Use the same block diagram, but with 


_s+2 
G,(s) = zoel (7-108) 


eS Se 
s(s + 1)(s + 2) 


H(s) = 5 (7-110) 


G,(s) = (7-109) 
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Fig. 7-28. Nyquist plot of G(s) = [K(s + 2)I/{(s + 10)[s(s + 1)(s + 2) 
+ SJ}. 


In this case we cannot use the method outline above, since the unknown gain 
parameter is in the inner loop. However, we may still use the Nyquist criterion 
to solve this problem. The open-loop transfer function of the system is 


~~ G,(s)G,(s) 
9) = TL G@HO) (7-111) 


= s+2 
~ (s + 10)[s(s + 1)(s + 2) + 5K] 


Since the unknown parameter K does not appear as a gain factor of G(s), | 
it would be of no avail to sketch the Nyquist locus of G(s)/K. However, we can | 
write the characteristic equation of the overall system as | 


s(s + 10)(s + 1)(s + 2) + 5 +24 5K(s + 10) = (7-112) 


In order to create an equivalent open-loop transfer function with K as a 
multiplying factor, we divide both sides of Eq. (7-112) by terms that do not 
contain K. We have 


1+ kee) =0 (7-113) 


8s + 10s + 1s + 2)+5+2— 

Since this equation is of the form 1 -+ G,(s) = 0, the roots of the charac- 
teristic equation may be investigated by sketching the Nyquist locus of G(s). 
However, the poles of G(s) are not known, since the denominator of G,(s) is 
not in factored form. The zeros of the polynominal s(s + 10)(s + 1)(s + 2) + 
5 + 2 may be studied by investigating the Nyquist plot of still another function 
G,(s), which we create as follows: 

s+2 

s(s + 10)(s + 1)(s + 2) 
Figure 7-29 shows that the Nyquist locus of G,(s) intersects the real axis | 


to the right of the (—1, /0) point. Thus all the poles of G,(s) are in the left half | 
of the s-plane. The Nyquist plot of G(s) is sketched as shown in Fig. 7-30. Since 


G(s) = (7-114) 
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G,(s)-plane 


Fig. 7-29. Nyquist locus of Ga(s) = (s + 2)/{s(s + 10)(s + 1s + 2)]. 


7 Im G3(s) 
G3(s)-plane 


Re G; 


Fig. 7-30. Nyquist locus of G3(s) = [SK(s + 10)}/[s(s + 10)(s + 1)(s + 2) 
+s + 2). 


the intersect of the locus on the real axis is at —0. LK, the range of K for stability 
isO0< K< 10. 

In this section we have investigated the application of the Nyquist criterion 
to multiloop control systems. For analysis problems, the stability of the system 
can be investigated by applying the Nyquist criterion in a systematic fashion 
from the inner loop toward the outer loops. For design problems when a SyS~ 
tem parameter K is to be determined for stability, it is sometimes necessary to 
start with the characteristic equation, which may be written in the form 


P(s) + KO(s) = 0 (7-115) 


where P(s) and Q(s) are polynominals. The stability of the system is studied by 
sketching the Nyquist plot of the equivalent open-loop transfer function 


G(s) = “eo (7-116) 
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Thus we have also indicated a method of applying the Nyquist criterion 
to design a stable system by using the characteristic equation. The Nyquist 
locus represents a more convenient approach than the Routh—Hurwitz criterion, 
since the latter often involves the solution of an inequality equation in the high 
order of K, whereas in the Nyquist approach K can be determined from the 
intersection of the G(s) locus with the real axis. 

The stability analysis discussed thus far in this chapter can be applied to 
linear multivariable systems. Since the characteristic equation of a multivariable 
is still written 

|sI — A| =0 (7-117) 
the Routh-Hurwitz criterion is applied in the usual manner. We can also apply 
the Nyquist criterion to Eq. (7-117) in the manner outlined in Eqs. (7-115) and 
(7-116). On the other hand, since the stability of a linear system is independent 
of the inputs and outputs of the system, we can apply the Nyquist criterion to 
a multivariable system between any input-output pair while setting all other 
inputs to zero, as long as the system is completely controllable and observable. 


7.10 Stability of Linear Control Systems with Time Delays 


Systems with time delays and their modeling have been discussed in Section 
5.12. In general, closed-loop systems with time delays in the loops will be subject 
to more stability problems than systems without delays. Since a pure time delay 
T, is modeled by the transfer function relationship e-7, the characteristic equa- 
tion of the system will no longer have constant coefficients. Therefore, the Routh— 
Hurwitz criterion is not applicable. However, we shall show in the following 
that the Nyquist criterion is readily applicable to a system with a pure time 
delay. 

Let us consider that the loop transfer function of a feedback control sys- 
tem with pure time delay is represented by 


G(s)H(s) = eG ,(s)H,(s) (7-118) 


where G,(s)H,(s) is a rational function with constant coefficients; 7, is the pure 
time delay in seconds. Whether the time delay occurs in the forward path or the 
feedback path of the system is immaterial from the stability standpoint. 

In principle, the stability of the closed-loop system can be investigated by 
sketching the Nyquist locus of G(s)H(s) and then observing its behavior with 
reference to the (—1, j0) point of the complex function plane. 

The effect of the exponential term in Eq. (7-118) is that it rotates the phasor 
G,(j@)H,(j@) at each w by an angle of @T, radians in the clockwise direction. 
The amplitude of G,(jw)H,(jq) is not affected by the time delay, since the 
magnitude of e~/®" is unity for all frequencies. 

In control systems the magnitude of G,(j/w)H,(/@) usually approaches zero 
as w approaches infinity. Thus the Nyquist locus of the transfer function of Eq. 
(7-118) will usually spiral toward the origin as @ approaches infinity, and there 
are infinite number of intersects on the negative real axis of the G(s)H(s)-plane. 
For the closed-loop system to be stable, all the intersects of the G/jw)H(jw) 
locus with the real axis must occur to the right of the (—1, /0) point. 
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jIm GH 


G(s)H(s)-plane 


Fig. 7-31. Nyquist plots of G(s)H(s) = e~T«5/[s(s + 1)(s + 2)]. 


Figure 7-31 shows an example of the Nyquist plot of 


eo Tas 
s(s + 1)(s + 2) 


for several values of T;. It is observed from this diagram that the closed-loop 
system is stable when the time delay 7, is zero, but the stability condition dete- 
riorates as 7, increases. The system is on the verge of becoming unstable when 
T, = 2sec. This is shown with the Nyquist plot passing through the (—1, /0) 
point. 

Unlike the rational function case, the analytical solution of the crossover 
points on the real axis of the G(s)H(s)-plane is not trivial, since the equations 
that govern the crossings are no longer algebraic. For instance, the loop transfer 
function of Eq. (7-119) may be rationalized in the usual manner by multiplying 
its numerator and denominator by the complex conjugate of the denominator. 
The result is 


G(s)H(s) = e-7G,(s)H,(s) = (7-119) 


G(jo)H (jw) = CS OTs — fsi9 oF a 2a oR — 0) (7-129) 
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The condition for crossings on the real axis of the G(s)H(s)-plane is 
3a? sin wT, — w(2 — w) cos wT, = 0 
which is not easily solved, given T,. 

Since the term e~/*?« always has a magnitude of | for all frequencies, the 
crossover problem is readily solved in the Bode plot domain (Appendix A). 
Since the time-delay term affects only the phase but not the magnitude of G( jw) 
H(ja), the phase of the latter is obtained in the Bode plot by adding a negative 
angle of —q@T, to the phase curve of G,(j@)H,(ja@). The frequency at which the 
phase curve of G(jw)H(ja@) crosses the 180° axis is the place where the Nyquist 
locus intersects the negative real axis. In general, analysis and design problems 
involving pure time delays are more easily carried out graphically in the Bode 
diagram. 

If the time delay is small, it is possible to approximate the time delay 
transfer function relation by a truncated power series; that is, 


Tis? Tis} 


ete = 1 — Tys + 8 ar ees (7-121) 


Figure 7-32 shows the Nyquist plots of the transfer function of Eq. (7-119) 


jim GH 


G(s)A(s)-plane 
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Two-term — 0.5 


approximation 


Fig. 7-32. Approximation of Nyquist plot of system with time delay by 
truncated power-series expansion. 
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with T, = 0.8 sec, and 


= 1 — T,s 


which is the result of truncating the series of Eq. (7-121) after two terms. 


7.11 Stability of Nonlinear Systems—Popov’s Criterion!**° 


It was mentioned in Section 7.1 that the stability analysis of nonlinear 
systems is a complex subject, and unlike the linear time-invariant case, no single 
method can be applied to all nonlinear systems. Although the major emphasis 
of this book is on linear systems, we shall show in the following that a certain 
class of nonlinear systems can be studied with stability criteria that are quite 
similar to the Nyquist criterion. 

When a system is nonlinear, it does not have a characteristic equation, 
and therefore there are no eigenvalues to speak of. The Routh—Hurwitz criterion 
becomes useless in this case. The kind of stability that we are concerned with 
here is asymptotic stability, which means that the equilibrium state x, is as- 
ymptotically stable if every motion starting at an initial state x, will converge 
to x, as time approaches infinity. 

Popov’s stability criterion applies to a closed-loop control system that con- 
tains one nonlinear element, as shown in Fig. 7-33. The nonlinearity is described 


Fig. 7-33. Nonlinear closed-loop control system. 


by a functional relation that must lie in the first and third quadrants, as shown 
in Fig. 7-34. 

Many nonlinear control systems in practice can be modeled by the block 
diagram and nonlinear characteristic of Figs. 7-33 and 7-34. For instance, Fig 
7-35 illustrates several common-type nonlinearities, which are encountered 
often in control systems that fit the characteristic specified by Fig. 7-34. 

Popov’s stability theorem is based on the following assumptions: 


1. The linear part of the system is described by the transfer function 
G(s), which has more poles than zeros, and there are no cancel- 
lations of poles and zeros. 

2. The nonlinear characteristic is bound by k, and k, as shown in Fig. 
7-34; or 

ki <N@)<k, (7-123) 


Fig. 7-34. Nonlinear characteristics. 


(a) Ideal relay 


(c) Saturation (d) Saturation with dead zone 


Fig. 7-35. Several common nonlinearities encountered in control sys- 
tems. (a) Ideal relay. (b) Relay with dead zone. (c) Saturation. (d) Satura- 
tion with dead zone. 
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The theorem is stated in the following without giving the proof: The closed- 
loop system is asymptotically stable if the Nyquist plot of G(j@) does not inter- 
sect or enclose the circle that is described by 

k, +k, 2_[k2—ki 
E TOR, te} DOs il oe oe Ge) 
where x and y denote the real and imaginary coordinates of the G(ja)- 
plane, respectively. 

It should be noted that the Popov stability criterion is sufficient but is not 
necessary. In other words, if the G(j@) locus does not intersect or enclose the 
circle, the system is stable, although the criterion is usually overly conservative. 
On the other hand, if the above condition is violated, it does not necessarily 
mean that the system is unstable. The possible implications are illustrated in 
Fig. 7-36. 


ijIlmG 


G(jw}plane 


ky —ky G(jw) 
2k, kp 


Result 
inconclusive 


Fig. 7-36. Interpretation of Popov’s stability criterion. 


It is interesting to observe that if the system is linear, k, = k, =k, the 
circle degenerates to the (—1, j0) point, and Popov’s criterion becomes Nyquist’s 
criterion. Figure 7-35 shows that a great majority of the nonlinearities in practice 
are with k, = 0. In these cases, the circle of Eq. (7-124) becomes a straight line 


wtb : 
x= Ee (7-125) 


For stability, the Nyquist locus of G(j@) must not intersect this line. 
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The following example serves to illustrate the practical application of the 
Popov stability criterion. 


EXAMPLE 7-10 Consider that the block diagram shown in Fig. 7-37 represents a 
feedback control system that has a saturation element in the forward 
path. The system could be a position control system using a motor 

as an actuator. The saturation is in the power amplifier of the motor controller, with 

K representing the gain of the linear portion of the amplifier characteristic. 


Fig. 7-37. Nonlinear system with a saturation characteristic. 


The linear transfer function of the system is 


1 


G(s) = s(s + 1)(s + 2) 


(7-126) 
It can be shown that if the saturation characteristic were absent, the closed-loop 
system would be stable for 0 < K < 6. It is desired to determine the value of K so 
that the nonlinear system is assured of stability. Notice that the Popov criterion is of 
such a nature that for the saturation nonlinearity, the result of the criterion is inde- 
pendent of the level of saturation, which is in a way a qualitativeness of the test. 

The Nyquist locus of G(j@) is sketched as shown in Fig. 7-38. For stability of the 
closed-loop system, the G(j@) locus must not intersect the vertical line, which passes 
through the point (—1/K, j0). 

The maximum value of K is determined by finding the maximum magnitude of the 
real part of G(j@). Rationalizing G(j@), the real part is written 


—3 


Re G(j@) = Jo? +O — op (7-127) 
The frequency at which Re G(j@) is a maximum is determined from 
ae eo 
which gives @ = 0. Thus 
Max. Re G(j@) = —} (7-129) 
and the closed-loop system is stable for 
K<#4 (7-130) 


which is considerably less than the critical value of K = 6 for the linear system. 
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Fig. 7-38. Application of the Popov stability criterion to the nonlinear 
system in Fig. 7-37. 
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PROBLEMS 


By means of the Routh—Hurwitz criterion, determine the stability of systems 
that have the following characteristic equations. In each case, determine the 
number of roots of the equation which are in the right-half s-plane. 

(a) s3 + 20s2 + 95s +100 =0 

(b) s3 + 20s? + 9s + 200 = 0 

(c) 3s + 1053 + 5s? +54+2=0 

(d) s* + 253 + 6s? + 85+ 8=0 

(e) s® + 255 + 854 + 1253 + 20s? + 16s + 16 =0 


The characteristic equations for certain feedback control systems are given 
below. In each case, determine the values of K that correspond to a stable 
system. 

(a) s* + 2253 + 10s? + 2s + K=0 

(b) s* + 20Ks3 + 5s? ++ (10+ K)s + 15 =0 

(c) s3 + (K + 0.5)s? + 4Ks + 50 =0 

The conventional Routh—Hurwitz criterion gives only the location of the roots 


of a polynomial with respect to the right half and the left half of the s-plane. 
The open-loop transfer function of a unity feedback control system is given as 


K 
i a s(1 + Ts) 
It is desired that all the roots of the system’s characteristic equation lie in the 
region to the left of the line s = —a. This will assure not only that a stable 


system is obtained, but also that the system has a minimum amount of damping. 
Extend the Routh—Hurwitz criterion to this case, and determine the values of K 
and 7 required so that there are no roots to the right of the line s = —a. 


The loop transfer function of a feedback control system is given by 
_ K(s + 1) 
G(S)H(8) = St Ta os) 


The parameters K and T may be represented in a plane with K as the horizontal 
axis and 7 as the vertical axis. Determine the region in which the closed-loop 
system is stable. 


The open-loop transfer function of a unity feedback control system is given by 


_ _K(s +5\(s + 40) 
S() = 3 + 200\5 + 1000) 
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7.6. 


7.7. 


7.8. 


7.9, 


Discuss the stability of the closed-loop system as a function of K. Determine 
the values of K that will cause sustained oscillations in the closed-loop system. 
What are the frequencies of oscillations? 


A controlled process is represented by the following state equations: 
X, =x, — 3x2 
Xy =S5x,; +u 
The control is obtained from state feedback such that 
ue = 1X1 + 82X2 


where g,; and g2 are real constants. Determine the region in the g2 versus g; 
plane in which the overall system is stable. 


Given a linear time-invariant system that is described by the following state 
equations: 
x(t) = Ax(t) + Bu(t) 


where 
0 1 0 0 
A=|0 0 1 B=/| 0 
0 -—3 -—2 1 


The closed-loop system is implemented by state feedback so that 
u(t) = —Gx(t) 


where G is the feedback matrix, G =[g; g2 g3] with g,, g2, and g3 equal to 
real constants. Determine the constraints on the elements of G:so that the 
overall system is asymptotically stable. 


Given the system x = Ax -- Bu, where 


1 0 0 2 
A=/0 -—2 0 B=! 0 
0 0 3 1 


Consider that state feedback may be implemented. Is the system stabilizable by 
state feedback ? 


For the following loop gain functions, sketch the Nyquist diagrams that 
correspond to the entire Nyquist path. In each case check the values of N, P, 
and Z with respect to the origin in the GH-plane. Determine the values of N, P, 
and Z with respect to the —1 point, and determine if the closed-loop system is 
stable. Specify in which case it is necessary to sketch only the Nyquist plot for 
@ = 0 to co (section 1) on the Nyquist path to investigate the stability of the 
closed-loop system. 


50 
(@) GH (8) = STON + 0.25) 
10 
(>) GOH) = BET O25N0 + O55) 
sg ION 
() GOA) = SF O.s\d + 0.580 + 0.85) 
5(1 — 0.53) 


@ GOH = SIT OisK — 0.255) 
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10 
©) GOH) = Toa =D 
(f) G(s)H(s) = 2.5(1 + 0.28) 


7.10. Sketch Nyquist diagrams for the following loop transfer functions. Sketch only 
the portion that is necessary to determine the stability of the closed-loop system. 
Determine the stability of the systems. 

100 
(a) G(s)H(s) ra s(s? + 2s + 2y(s + 1) 
50 


(b) G(s)H(s) = 50 FI +4) 


a Ss 

(c) G(s)H(s) wv ] — 0.25 

7.11. Figure P7-11 shows the entire Nyquist plots of the loop gains G(s)H(s) of some 
feedback control systems. It is known that in each case, the zeros of G(s)H(s) 


jim 


ge Jos GH-plane 


~~ @ Arrows on diagram 
Se = —_—— correspond to defined 
ae sense of the Nyquist 
path 
(a) 


(b) 
Figure P7-11. 
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7.12. 


7.13. 


7.14, 


- jIm 
w=-0 sa GH-plane 


(— 1,70) 


Figure P7-11 (Cont.). 


are all located in the left half of the s-plane; that is, Z = 0 with respect to the 
origin in the GH-plane. Determine the number of poles of G(s)H(s) that are in 
the right half of the s-plane. State the stability of the open-loop systems. State 
whether the closed-loop system is stable; if not, give the number of roots of the 
characteristic equation that are in the right half of the s-plane. 


The characteristic equation of a feedback control system is given by 
s3 + 5Ks? + (2K + 3)s +10 =0 


Apply the Nyquist criterion to determine the values of K for a stable closed- 

loop system, Check the answer by means of the Routh-Hurwitz criterion. 

The Nyquist criterion was originally devised to investigate the absolute stability 

of a closed-loop system. By sketching the Nyquist plot of G(s)H(s) that corre- 

sponds to the Nyquist path, it is possible to tell whether the system’s charac- 
teristic equation has roots in the right half of the s-plane. 

(a) Define a new Nyquist path in the s-plane that may be used to ensure that 
all the complex roots of the characteristic equation have damping ratios 
greater than a value ¢;. 

(b) Define a new Nyquist path in the s-plane that may be used to ensure that 
all the characteristic equation roots are in the left half of the s-plane with 
real parts greater than @,. 

The block diagram of a feedback control system is shown in Fig. P7-14. 

(a) Determine the values of a so that the system is stable. 


ss + 2) + 3) C(s) 


Figure P7-14. 
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(b) Determine the values of a so that the eigenvalues of the system all lie to the 


left of the Re(s) = —1 line in the s-plane. 
7.15. The block diagram of a multivariable control system is shown in Fig. P7-15. 


C\ (s) 


Figure P7-15. 


The transfer function G(s) is given by 
K 
OS) = GENEFD 
| and K is a positive constant. Determine the range of K so that the system is 
| asymptotically stable. 
(a) Use the Routh—Hurwitz criterion. 
(b) Use the Nyquist criterion. 
7.16. Figure P7-16 shows the block diagram of a control system in which the amplifier 


Amplifier 
characteristic 


G(s) = 


K 
s(1 +0.1s)Q1 + 0.2s) 


Figure P7-16. 
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has a nonlinear saturation characteristic. Determine the maximum value of K 
such that the overall system will be absolutely stable. 


7.17, Figure P7-17 shows a control system that has a synchro control transformer as 
an error transducer. The output of the synchro is proportional to the sine of the 
input shaft position. Assuming that the synchro operation is limited to 
—n/2 < 0, < 2/2, the input-output characteristic of the device may be repre- 
sented by the sine wave shown in Fig. P7-17. Determine the limiting value of 
K so that the system is absolutely stable. 


Synchro 
control 
transformer 


K 


GO) * rs OS +5) 


Synchro 
— 10 characteristic 


Figure P7-17. 
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Root Locus Techniques 


8.1 


Introduction 


In the design of control systems it is often necessary to investigate the perfor- 
mance of a system when one or more parameters of the system varies over 
a given range. Since the characteristic equation plays an important role in the 
dynamic behavior of linear systems, an important problem in linear control 
systems theory is the investigation of the trajectories of the roots of the charac- 
teristic equation, or simply, the root loci, when a certain system parameter 
varies. In fact, the examples of Chapter 6 already have illustrated the importance 
of the root loci in the study of linear control systems. 

The root locus technique is not confined to the inclusive study of control 
systems. The equation under investigation does not necessarily have to be the 
characteristic equation of a linear system. The technique can also be used to 
assist in the determination of roots of high-order algebraic equations. 

In general, the root locus problem for one variable parameter can be defined 
by referring to equations of the following form: 


F(s) = s*"+ ays" 3+... +4a,.8+ 4, 
+ K(s™ + bs"! +...+6,.,5+ 6,) =90 


where K is the parameter considered to vary between —co and oo. The coeffi- 
cients a,,...,4@,,5,,..., 5, 1, 6, are assumed to be fixed. These coefficients 
can be real or complex, although our main interest here is in real coefficients. 
The root locus problem of multiple-variable parameters will also be considered 
in this chapter. 

Although the loci of the roots of Eq. (8-1) when K varies between — co and 


(8-1) 


375 
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oo are generally referred to as the root loci in control system literature, the follow- 
ing categories are defined: 


1. Root loci: the portion of the root loci when K assumes positive 
values; that is, 0 < K < oo, 

2. Complementary root loci: the portion of the root loci when K 
assumes negative values; that is, —co < K <0. 

3. Root contours: loci of roots when more than one parameter varies. 


The complete root loci refers to the combination of the root loci and the 
complementary root loci. 


8.2 Basic Conditions of the Root Loci 


Since our main interest is in control systems, let us consider that Eq. (8-1) is 
the characteristic equation of a linear control system that has the closed-loop 
transfer function 
Cls)_ GS) 
Rs) — 1+ GAG) ven 
The characteristic equation is obtained by setting the numerator of I + 
G(s)H(s) to zero. In other words, the left side of Eq. (8-1) should correspond to 
the numerator of 1 + G(s)H(s). Or, the roots of the characteristic equation must 
also satisfy 
1 + G(s)H(s) = 0 (8-3) 
The reader should have a special understanding of the relationship between 
the characteristic equation, the equation 1 + G(s)H(s) = 0, and the function 
G(s)H(s). Although these relationships are very simple to understand, one can 
easily overlook these important concepts when deeply entangled in the intri- 
cacies of the construction of the root loci. 
If we divide both sides of Eq. (8-1) by the terms that do not contain K, we 
get 
K(s™ + bs™ 1 4+-...4+6,-15 + 5,) : 
"+asi+...+a4,-.54+4, = (8-4) 
Comparing Eqs. (8-3) and (8-4) we see that the following relation can be estab- 
lished: 


1+ 


_ K(s™ + bys™! + + bn 5 + On) 

HN) = aE Faas + e) 
where G(s)H(s) is known as the loop transfer function of the control system. 
Since we have mentioned that the root locus technique is not limited to control 
systems, in general, given Eq. (8-1), we can regard G(s)H(s) of Eq. (8-5) as the 
loop transfer function of an equivalent control system. The control system 
is equivalent in the sense that it has Eq. (8-1) as its characteristic equation. 
Later we shall discover that the step in obtaining Eq. (8-4) from Eq. (8-1) is a 
very useful one in many other analysis and design situations. For lack of a better 
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name, we shall refer to the procedure of dividing both sides of the characteristic 
equation by the terms that do not contain K as the Golden Rule. 

We can now define the complete root loci as the loci of the points in the 
s-plane that satisfy Eq. (8-3) as K is varied between —oo and oo. 

Now we are ready to establish the conditions under which Eq. (8-3) is 
satisfied. Let us express G(s)H(s) as 


G(s)H(s) = KG,(s)H,(s) (8-6) 


where G,(s)H,(s) no longer contains the variable parameter K. Then Eq. (8-3) is 
written 


G()H(s) = —f (8-7) 

To satisfy this equation, the following conditions must be met simultaneously: 
G()H(S)| = 97 —co < K < 00 (8-8) 

/G.(s)H,(s) = (2k + 1)x K>0 (8-9) 

/G,(s)H\(s) = 2kx K<0 (8-10) 


where k = 0, +1, +2, ... (all integers). 

In practice, the complete root loci are constructed by finding all points in 
the s-plane that satisfy Eqs. (8-9) and (8-10), and then the values of K along the 
loci are determined using Eq. (8-8). 

The construction of the root loci is basically a graphical problem, although 
some of the rules of construction are arrived at analytically. The starting point 
of the graphical construction of the root loci is based on knowledge of the poles 
and zeros of the function G(s)H(s). In other words, Eq. (8-5) must first be 
written* 

_ K(s + 21:)(s + 22)... (8 + Zn) 
HM) = CF DNS + Pa). + Pd (8-11) 
= KG(s)H(s) 


where the poles and zeros of G(s)H(s) are real or complex-conjugate numbers. 
Using Eq. (8-11), the conditions stated in Eqs. (8-8), (8-9), and (8-10) 
become 


Il s +z 1 


|G,(s)H,(s)| = 4+ ——__= 7p —0o <K< oo (8-12) 


and 
[G(s\H(s) = 3 [s+ 2 — 3 Is + py 
=(2k+1)x 0<K<o 


(8-13) 


*We shall first consider that G(s)H(s) is a rational function of s. For systems with time 
delays, G(s)H(s) wiil contain exponential terms such as e-Ts, 
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[G(s)Hy(s) = 3) [s+ — % [s+ pi 
= 2kn —wo< K<0 


(8-14) 


fork = 0, +1, +2,.... 

It was mentioned earlier that Eqs. (8-13) and (8-14) may be used for the 
construction of the complete root loci in the s-plane. In other words, Eq. (8-13) 
implies that for any positive value of K, a point (e.g., s,) in the s-plane is a point 
on the root loci if the difference between the sums of the angles of the vectors 
drawn from the zeros and the poles of G(s)H(s) to s; is an odd multiple of 
180°. Similarly, for negative values of K, Eq. (8-14) shows that any point on the 
complementary root loci must satisfy the condition that the difference between 
the sums of the angles of the vectors drawn from the zeros and the poles to 
the point is an even multiple of 180°, or 0°. 

To illustrate the use of Eqs. (8-13) and (8-14) for the construction of the 
root loci, let us consider 

ne K(s + 21) S 
HMO) = SF Ne + Ps) e)) 
The locations of the poles and the zero of G(s)H(s) are arbitrarily assumed, as 
shown in Fig. 8-1. Next, we select an arbitrary point, s,, in the s-plane and draw 
vectors directing from the poles and the zero of G(s)H(s) to the point s,. If s, 


Fig. 8-1. Pole-zero configuration of G(s)H(s) = [K(s + 71)I/[s(s + p2) 
(s + ps)l- 
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is indeed a point on the root loci (0 << K < oo) [remember that the root loci 
represent the loci of zeros of 1 + G(s)H(s)], it must satisfy the following two 
conditions simultaneously: from Eq. (8-12), 


[si +2,| I (8-16) 


Isy|[s; + polls: + ps] [KI 
and from Eq. (8-13), 


[s; + 21 — (/si + [s1 + p2+ /s: + ps) = (2k + Ia k=0,+1,42,... 
(8-17) 
Similarly, if s, is to be a point on the complementary root loci (co < K 
< 0), it must satisfy Eq. (8-14); that is, 
[s +21 — (/s1 + [81 + po + [81 + ps) = 2ka (8-18) 


fork =0, +1, +2,.... 

As shown in Fig. 8-1, the angles 6,,, 9,,, @,,, and 6,, are the angles of the 
vectors measured with the positive real axis as zero reference. Equations (8-17) 
and (8-18) become 


9:, — (85, + 8,, + 9,,) = (2k + 1)x 0<K<o (8-19) 
and 

6,, — @,, + 6,, + 9,,) = 2kn —0o<K<0 (8-20) 
respectively. 


If s, is found to satisfy either Eq. (8-19) or Eq. (8-20), Eq. (8-16) is used to 
determine the value of K at the point. Rewriting Eq. (8-16), we have 


K — sills; + polls: + ps! 8-21 
| K| sal (8-21) 
where the factor |s, + z,| is the length of the vector drawn from the zero z, to 
the point s,. If, as in Fig. 8-1, the vector lengths are represented by A, B, C, and 
D, Eq. (8-21) becomes 
BCD 


|K| = 46 


(8-22) 

The sign of K, of course, depends on whether s, is on the root loci or the 
complementary root loci. Consequently, given the pole-zero configuration of 
G(s)H(s), the construction of the complete root locus diagram involves the 
following two steps: 


1. A search for all the s, points in the s-plane that satisfy Eqs. (8-9) 
and (8-10). 

2. The determination of the values of K at points on the root loci and 
the complementary root loci by use of Eq. (8-8). 


From the basic principles of the root locus plot discussed thus far, it may 
seem that the search for all the s, points in the s-plane that satisfy Eqs. (8-9) 
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and (8-10) is a very tedious task. However, aided with the properties of the root 
loci that we are going to assemble in the next section, the actual sketching of 
the root locus diagram in most cases is not so formidably complex. Normally, 
with some experience on the part of the analyst, the root loci can be sketched by 
following through the “rules” of construction. A special graphical aid, called 
the Spirule, can also be used to help plot the root locus diagram. However, 
since the Spirule is simply a device that assists in adding and subtracting angles 
of vectors quickly, according to Eq. (8-13) or Eq. (8-14), it can be used effectively 
only if we already know the general proximity of the roots. Indeed, when we set 
out to find a point s, on the root loci, we must first have some general knowledge 
of the location of this point; then we select a trial point and test it in Eqs. (8-13) 
and (8-14). If the trial point is not close to any point on the root loci, the search 
procedure can be frustrating, even with the aid of a Spirule. 

Digital and analog computer programs??-** can be prepared for the plotting 
of the root locus diagram. Analytical procedures?*?° have also been developed 
for obtaining the root loci. In fact, a computer or the analytical method must 
be used if the poles and zeros of G(s)H(s) are not known a priori. 

The material presented in this chapter will emphasize the principle of con- 
struction of the root loci, since one must obtain a thorough understanding of 
the basic principles before any engineering implementation or numerical 
methods can be applied successfully. 


8.3 Construction of the Complete Root Loci 


The following rules of construction are developed from the relation between 
the poles and zeros of G(s)H(s) and the zeros of 1 + G(s)H(s). These rules should 
be regarded only as an aid to the construction of the root loci and the comple- 
mentary root loci, as they do not give the exact plots. 


K = 0 Points 


Theorem 8-1. The K = 0 points on the complete root loci are at the poles 
of G(s) H(s). 


Proof: From Eq. (8-12), 
I [s+ z;| I 
|G,(s)H,(s)| = 4+——_ = TKI (8-23) 


ls + el 


As K approaches zero, the value of Eq. (8-23) approaches infinity, and, 
correspondingly, s approaches the poles of G,(s)H,(s) or of G(s)H(s); that is, 
s approaches —p, (j= 1,2,...,n). It is apparent that this property applies 
to both the root loci and the complementary root loci, since the sign of K has 
no bearing in Eq. (8-23). 
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ExampLe 8-1 — Consider the following equation: 
s(s + 2)s + 3) + K(s +1) =0 (8-24) 


When K = 0, the three roots of the equation are at s = 0, s = —2,ands = —3. These 
three points are also the poles of the function G(s)H(s) if we divide both sides of Eq. 
(8-24) by the terms that do not contain K (the Golden Rule) and establish the relation- 
ship 

1+ G(s)H(s) =1 + Tene Ss =0 (8-25) 
Thus 

K(s + 1) 

s(s + 2)(s + 3) 


The three K = 0 points on the complete root loci are as shown in Fig. 8-2. 


G(s)H(s) = (8-26) 


s-plane 


Fig. 8-2. Points at which K = 0 on the complete root loci of s(s + 2) 
(s+ 3)+ K(s +1) =0, 


K = +00 Points 


Theorem 8-2. The K == +00 points on the complete root loci are at the 
zeros of G(s)H(s). 


Proof: Referring again to Eq. (8-23), as K approaches +o, the equation 
approaches zero. This corresponds to s approaching the zeros of G(s)H(s); or 
s approaching —z, (i= 1, 2,...,m). 


EXAMPLE 8-2 Consider again the equation 


s(s + 2Ms +3) + K(s +1) =0 (8-27) 
It is apparent that when K is very large, the equation can be approximated by 
K(s+1)=0 (8-28) 


which has the root s = —1. Notice that this is also the zero of G(s)H(s) in Eq. (8-26). 
Therefore, Fig. 8-3 shows the point s = —1 at which K = -- co, However, G(s)H (s) in 
this case also has two other zeros located at infinity, because for a rational function, 
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s-plane 4 iw 


Two other K = + 
points at infinity 


Fig. 8-3. Points at which K = +0 on the complete root loci of s(s + 2) 
(s+3)+ Ks+)=90. 


the total number of poles and zeros must be equal if the poles and zeros at infinity are 
included. Therefore, for the equation in Eq. (8-27), the K = + °° points areat s = —1, 
oc, and oo, 


Number of Branches on the Complete Root Loci 


A branch of the complete root loci is the locus of one root when K takes on 
values between —co and oo. Since the number of branches of the complete root 
loci must equal the number of roots of the equation, the following theorem 
results: 


Theorem 8-3. The number of branches of the root loci of Eq. (8-1) is equal to 
the greater of n and m. 


EXAMPLE 8-3. The number of branches on the complete root loci of 
s(s + 2)8 +3) 4+ K+) =0 (8-29) 


is three, since n = 3 and m = 1. Or, since the equation is of the third order in s, it 
must have three roots, and therefore three root loci. 


Symmetry of the Complete Root Loci 


Theorem 8-4. The complete root loci are symmetrical with respect to the 
real axis of the s-plane. In general, the complete root loci are symmetrical with 
respect to the axes of symmetry of the poles and zeros of G(s)H(s). 


Proof: The proof of the first statement is self-evident, since, for real coeffi- 
cients in Eq. (8-1), the roots must be real or in complex-conjugate pairs. 

The reasoning behind the second statement is also simple, since if the poles 
and zeros of G(s)H(s) are symmetrical to an axis other than the real axis in the 
s-plane, we can regard this axis of symmetry as if it were the real axis of a new 
complex plane obtained through a linear transformation. 


Sec. 8.3 Construction of the Complete Root Loci / 383 


EXAMPLE 8-4 Let us consider the equation 


s(s+1Xs+2)+K=0 (8-30) 
Dividing both sides of the equation by the terms that do not contain K leads to 
K 
The complete root loci of Eq. (8-30) are sketched as shown in Fig. 8-4. Notice that 
since the poles of G(s)H(s) are symmetrical with respect to the s = —1 axis (in addition 
to being always symmetrical with respect to the real axis), the complete root loci are 
symmetrical to the s = ~1 axis and the real axis. 


~ A jw oo 


| Axis of 

| symmetry 
/ | 
: | 

/ 
/ | 
4 K<0 | 
id | 
/ 
é | 
/ 

7 . ra 
Pf v x Axisof | 
Piz symmetry | 


Fig. 8-4. Root loci of s(s + 1)(s + 2) + K = 0, showing the properties 
of symmetry. 


EXxAmpLe 8-5 When the pole-zero configuration of G(s)H(s) is symmetrical with 
respect to a point in the s-plane, the complete root loci will also be 
symmetrical to that point. This is illustrated by the root locus plot of 


sis +2)s+1+ 7)s+1—-js)+K=0 (8-32) 
as shown in Fig. 8-5. 
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x 


Fig. 8-5. Root loci of s(s + 2)(s + 1 +/)(s + 1 —/j) + K == 0, showing 
the properties of symmetry. 


Asymptotes of the Complete Root Loci (Behavior of Root Loci at s = co) 


The properties of the complete root loci near infinity in the s-plane are 
important, since when n 4 m, 2|n — m| of the loci will approach infinity in 
the s-plane. 


Theorem 8-5. For large values of s, the root loci for K > 0 are asymptotic to 
straight lines or asymptotes with angles given by 


go, — Gk + De (8-33) 


n—m 


where k = 0,1, 2,...,|n — m|— 1* andn and mare defined in Eq. (8-1). 
For the complementary root loci, K <0, the angles of the asymptotes are 


2kn 
= 8-34 
= - (8-34) 
wherek = 0,1, 2,...,|n—m|— 1. 
*According to the defining equations of the root loci, kK = 0, +1, 4:2,.... However, 


since there are only | — m| asymptotes for each type of root loci, we need to assign only 
|n — m| values to k. 
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Equations (8-33) and (8-34) imply that the asymptotes of the complementary 
root loci are linear extensions of the asymptotes of the root loci, and vice versa. 
When the asymptotes of one type of root loci are determined, those of the other 
type are found without further calculation. 


Proof: Let us divide both sides of Eq. (8-1) by 


s™ t+ bys™!'+...+6,-18+ 6, 
We then have 


Si tas" 3+...+a, is +a, : 
s™ + bys™ 1 + Bs + By Wee (2-39) 


Carrying out the fraction of the left side of Eq. (8-35) by the process of 
long division, and for large s neglecting all but the first two terms, we have 


s’7™ +. (a, — b)s"- "1 > —K (8-36) 
or 


s(1 +421 gi ‘aaa = (—K)ie-m (8-37) 


The factor [1 + (a, — b,)/s}'““-™ in Eq. (8-37) is expanded by binomial expan- 
sion, and Eq. (8-37) becomes 


s[1 Pisa est oe ..;=CKie (8-38) 


a= m)s 
Again, if only the first two terms in the last series are retained, we get 


5 +& a1 te K)ve- m) (8-39) 


Now let s = o + jo, and, using DeMoivre’s algebraic theorem, Eq. (8-39) is 
written 


F — by ra 2k +1 “aes (2 1 
o+jo+ — can Gis | cos Gk + Ds + Da + j sin Ch De! (8-40) 


for 0 < K < oo, and 


o + jo + BB = | ue ™|[ cos >A". jsin | (8-41) 


for —co << K<0,andk =0, +1, +2,.... 
Equating the real and imaginary parts of both sides of Eq. (8-40), we have, 
for0< K< o&, 


5 +o 4s =~ KiV/0-™ cos Ge = ou (8-42) 
and 
@ = Kvo-m gin CK + Ur (8-43) 
n—m 


Solving for K!/"-™ from Eq. (8-43), we have 


KVe-m = __@ (8-44) 
sin 2k 1, 2k +17 
n—m n—m 
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or 


~ tay (2k + me ( a, —b, 7 
o = tant 8g + = "1) (8-45) 
Equation (8-45) represents a straight line in the s-plane, and the equation is of 
the form 
o = M(o — 0;) (8-46) 


where M represents the slope of the straight line or the asymptote, and a, is 
the intersect with the o axis. 
From Eqs. (8-45) and (8-46) we have 


M=tan2k+1, (8-47) 
n—m 
k=0,1,2,...,|n — m|— 1, and 
_ _a—)b, is 
o,=—-A (8-48) 


Note that these properties of the asymptotes are for the root loci (0 << K < oo) 
only. : 

Similarly, from Eq. (8-41) we can show that for the complementary root 
loci (co < K <0), 


M = tan 252 
n— 


(8-49) 
k=0,1,2,...,|”2—m|—1, and the same expression as in Eq. (8-48) is 
obtained for ¢,. Therefore, the angular relations for the asymptotes, given by 
Eqs. (8-33) and (8-34), have been proved. This proof also provided a by- 
product, which is the intersect of the asymptotes with the real axis of the 
s-plane, and therefore resulted in the following theorem. 


Intersection of the Asymptotes (Centroid) 


Theorem 8-6. (a) The intersection of the 2\|n — m| asymptotes of the com- 
plete root loci lies on the real axis of the s-plane. 
(b) The intersection of the asymptotes is given by 


o,= ma a (8-50) 


where a,, b,,n, and m are defined in Eq. (8-1). 


Proof: The proof of (a) is straightforward, since it has been established 
that the complete root loci are symmetrical to the real axis. 
The proof of (b) is a consequence of Eq. (8-48). Furthermore, if we define 
a function G(s)H(s) as in Eq. (8-5), Eq. (8-50) may be written as 
o,= by — a 
n—m 
__ finite poles of G(s)H(s) — > finite zeros of G(s) H(s) (8-51) 
~~ number of finite poles of G(s)H(s) 
— number of finite zeros of G(s) H(s) 
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since from the law of algebra, 
—a, = sum of the roots of s* + a,s""' +-...+ a4,,5 + 4,=0 
= sum of the finite poles of G(s)H(s) 
—b, = sum of the roots of s™ + b,s""' + ...+ 6,-,8 + b, =0 
= sum of the finite zeros of G(s)H(s) 


(8-52) 


(8-53) 


Since the poles and zeros are either real or complex-conjugate pairs, the imagi- 
nary parts always cancel each other. Thus in Eq. (8-51) the terms in the summa- 
tions may be replaced by the real parts of the poles and zeros of G(s)H(s), 
respectively. 

It should be noted that Eq. (8-51) is valid for the root loci as well as the 
complementary root loci. 


EXAMPLE 8-6 Consider the equation 
s(s + 4)(s? + 25 + 2) + K(s +1) =0 (8-54) 


This equation corresponds to the characteristic equation of a feedback control system 
with the loop transfer function 

= K(s +1) 
C)H(S) = 55 F ays? F 2s FD) 
The pole-zero configuration of G(s)H(s) is shown in Fig. 8-6. From the six theorems 


on the construction of the complete root loci described so far, the following information 
concerning the root loci and the complementary root loci of Eq. (8-54) is obtained: 


(8-55) 


1. K =0: The K = 0 points on the complete root loci are at the poles of 
G(s)H(s): s = 0, s 4,5 1+ 1, and s = —1~—j1. 

2. K = +00: The K = +c points on the complete root loci are at the zeros 

of G(s)H(s): s l,s=o,5s =o, ands =o. 

. Since Eq. (8-54) is of the fourth order, there are four complete root loci. 

. The complete root loci are symmetrical to the real axis. 

5. For large values of s, the root loci are asymptotic to straight lines with 
angles measured from the real axis: Root loci (K > 0), Eq. (8-33): 


WwW 


k — 0 oO, = =e = 60° 

k=1 6, = ~ = 180° 

k=2 0,=% — 300° 
The angles of the asymptotes of the complementary root loci are given 
by Eq. (8-34): 

0° é 
k=1 6, = 38 = 120° 
pas G2 23 
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Asymptotes of | / 
root loci 


Asymptotes of 
complementary root loci \ 


Fig. 8-6. Asymptotes of the complete root loci of s(s + 4)(s? -+ 2s + 2) 
+ K(s+1)=0. 


The asymptotes of the complementary root loci may be obtained by extend- 

ing the asymptotes of the root loci. 
6. The six asymptotes of the complete root loci intersect at 

_ Di finite poles of G(s)H(s) — > finite zeros of G(s)H(s) 
pre n—m 
@O-—4—-—1+jl—-1—j)-(-)_ 5 
4-1 = 3 

The asymptotes are sketched as shown in Fig. 8-6. 


Co 
(8-56) 


EXAMPLE 8-7 The asymptotes of the complete root loci for several different equations 
are shown in Fig. 8-7. 


Root Loci on the Real Axis 


Theorem 8-7. (a) Root loci: On a given section of the real axis, root loci 
(K > 0) may be found in the section only if the total number of real poles and 
zeros of G(s)H(s) to the right of the section is odd. 

(b) Complementary root loci: On a given section of the real axis, comple- 
mentary root loci (K < 0) may be found in the section only if the total number of 
real poles and zeros of G(s)H(s) to the right of the section is even. Alternatively, 


Asymptotes of 


’ 1S) ' Te) 
slane | ae ead 
| % Ko 
Asymptote of | x Asymtotes of 
root locus | \ Ke f root loci # 
» | 
Asymptote of \ 
\ 
o 
Pa (P, + P2 + P3) 
er no Dd 
/ a | \ 
7 | \ 
7 | N\ 
7 | \ 
7 
7 | \ 
| 
G(s)H(s) = —— Bie Ne 
()H(s) s(s + p,) Cone) s(s + py Ms + pz (s+ p3) 
s-plane \ Asymptotes of / jw s-plane | 1a) 
complementary \ | 77 
\ root loci \ 7 
7 


\ Asymptotes of 'Asymptotes of / 
\ complementary! root loci / 


\ root loci 
ey aa, 
7 


_ 7 (P1 + P2 +3) 


FA ° 
on 5 oe {ASP 
go aN 
7 
7 
Pe 
, / 
/ 
/ 
/ 
K a K(s +z) 
G(s)H(s)= G(s)H(s) = 
OOO 25 + Di Ns+ Pi NS* Ps) CUS) ee py Me +0 3) 


Fig. 8-7. Examples of the asymptotes of root loci. 
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we can state that complementary root loci will be found in sections on the real axis 
not occupied by the root loci. 

In all cases the complex poles and zeros of G(s)H(s) do not affect the existence 
properties of the root loci on the real axis. 


Proof: The proof of the theorem is based on the following observations: 


1. At any point (e.g., s,) on the real axis, the angles of the vectors drawn 
from the complex-conjugate poles and zeros of G(s)H(s) add up to 
be zero. Therefore, the only contribution to the angular relations in 
Eqs. (8-13) and (8-14) is from the real poles and zeros of G(s)H(s). 

2. Only the real poles and zeros of G(s)H(s) that lie to the right of the 
point s, may contribute to Eqs. (8-13) and (8-14), since real poles 
and zeros that lie to the left of the point contribute zero degrees. 

3. Each real pole of G(s)H(s) to the right of the point s, contributes 
—180° and each zero to the right of the point contributes 180° to 
Eqs. (8-13) and (8-14). 


The last observation shows that for s, to be a point on the root loci, there 
must be an odd number of poles and zeros of G(s)H(s) to the right of s,, and for 
5, to be a point on the complementary root loci the total number of poles and 


s-plane jw 


Complementary 
root loci 


Root loci 


Jw 


s-plane 


Complementary 
root loci 


Root loci 


Fig. 8-8. Properties of root loci on the real axis. 
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zeros of G(s)H(s) to the right of s, must be even. The following example illus- 
trates the properties of the complete root loci on the real axis of the s-plane. 


EXAMPLE 8-8 The complete root loci on the real axis in the s-plane are shown in 
Fig. 8-8 for two different pole-zero configuraions of G(s)H(s). No- 
tice that the entire real axis is occupied by either the root loci or the 

complementary root loci. 


Angles of Departure (from Poles) and the Angles of Arrival (at Zeros) 
of the Complete Root Loci 


The angle of departure (arrival) of the complete root locus at a pole (zero) 
of G(s)H(s) denotes the behavior of the root loci near that pole (zero). For the root 
loci (K > 0) these angles can be determined by use of Eq. (8-13). For instance, in 
the pole-zero configuration of G(s)H(s) given in Fig. 8-9, it is desired to deter- 


s-plane 


Fig. 8-9. Complete root loci of s(s + 3)(s? + 2s + 2) + K = 0 to illus- 
trate the angles of departure or arrival. 
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mine the angle at which the root locus leaves the pole at — 1 +- j1. Notice that 
the unknown angle @, is measured with respect to the real axis. Let us assume 
that s, is a point on the root locus leaving the pole at —1 + /1 and is very near 
the pole. Then s, must satisfy Eq. (8-13). Thus 


/G(s,)H(s1) = —(6,+ 6, +6; + 6,) = (2k + 1)180° (8-57) 


Since s, is very close to the pole at —1-+ j1, the angles of the vectors drawn 
from the other three poles are determined from Fig. 8-9, and Eq. (8-57) becomes 


—(135° + 8, + 90° + 26.6°) = (2k + 1)180° (8-58) 


We can simply set & equal to zero, since the same result is obtained for all 
other values. Therefore, 


6, = —431.6° 
which is the same as —71.6°. 
When the angle of the root locus at a pole or zero of G(s) H(s) is determined, 
the angle of the complementary root loci at the same point differs from this 
angle by 180°, since Eq. (8-14) must now be used. 


Intersection of the Root Loci with the Imaginary Axis 


The points where the complete root loci intersect the imaginary axis of the 
s-plane, and the corresponding values of K, may be determined by means of the 
Routh-Hurwitz criterion. 

For complex situations with multiple intersections, the critical values of 
K and w may be more easily determined approximately from the Bode diagram. 


EXAMPLE 8-9 The complete root loci of the equation 
s(s + 3)(s? + 25+ 2) + K=0 (8-59) 
are drawn in Fig. 8-9. The root loci intersect the j@-axis at two conjugate points. 


Applying the Routh—Hurwitz criterion to Eq. (8-59), we have, by solving the auxiliary 
equation, K, = 8.16 and @, = +1.095 rad/sec. 


Breakaway Points (Saddle Points) on the Complete Root Loci 


Breakaway points or saddle points on the root loci of an equation corre- 
spond to multiple-order roots of the equation. Figure 8-10(a) illustrates a case 
in which two branches of the root loci meet at the breakaway point on the real 
axis and then depart from the axis in opposite directions. In this case the break- 
away point represents a double root of the equation to which the root loci 
belong. Figure 8-10(b) shows another common situation where a breakaway 
point may occur. 

In general a breakaway point may involve more than two root loci. Figure 
8-11 illustrates a situation where the breakaway point represents a fourth-order 
root. 

A root locus diagram can, of course, have more than one breakaway point. 
Moreover, the breakaway points need not always be on the real axis. However, 
because of the conjugate symmetry of the root loci, the breakaway points must 
either be real or in complex-conjugate pairs. 
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Fig. 8-10. Examples of breakaway points on the real axis in the s-plane. 


Fig. 8-11. Fourth-order breakaway point. 


Because of the symmetry of the root loci, it is easy to see that the root loci 
in Fig. 8-10(a) and (b) break away at 180° apart, whereas in Fig. 8-11 the four 
root loci depart with angles 90° apart. In general, if n root loci (— co < K < co) 
approach or leave a breakaway point, they must be 180/n degrees apart. 
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Several graphical and analytical methods are available for the determination 
of the location of the breakaway points. Two analytical methods that seem to 
be the most general are presented below. 


Method 1. 


Theorem 8-8. The breakaway points on the complete root loci of 1+ 
KG,(s)H,(s) = 0 must satisfy 


dG ,(s)H,(s) _ Zs 
Sage 0 (8-60) 
Proof: Let Eq. (8-1) be written 
O(s) + KP(s) = 0 (8-61) 
Then Eq. (8-5) may be written 
_ KP(s) : 
G(s)H(s) = Os) (8-62) 
If we consider that K is varied by an increment AK, Eq. (8-61) becomes 
O(s) + (K +AK)P(s) = 0 (8-63) 
Dividing both sides of Eq. (8-63) by Q(s) + KP(s), we have 
1+->AKPG) __9 (8-64) 


O(s) + KP(s) ~ 
which can be written 

1+ AKF(s) =0 (8-65) 
where 

P(s) 
F(s) = — 8-66 

©) = OG KPC) Soa 
Since the denominator of F(s) is the same as the left-hand side of Eq. (8-61), at 
points very close to an mth-order root s = s, of Eq. (8-61), which corresponds to 
a breakaway point of 7 loci, F(s) can be approximated by 

we Ay oe 3 
F(iy)= Goa sy (8-67) 
where A, is a constant. 
Substituting Eq. (8-67) into Eq. (8-65) gives 


pe a =) (8-68) 
from which we obtain ce Age 
yeaa? F (8-69) 
Taking the limit on both sides of the last equation as AK approaches zero, we 
have 
lim AK _ aK _ 9 (8-70) 


ax+o As ds 
We have shown that at a breakaway point on the root loci, dK/ds is zero.* 
*The quantity (ds/s)/(dK/K) is defined as the root sensitivity4¢-+6 of an equation with 


respect to incremental variation of the parameter K. In this case it is proved that at the break- 
away points of the root loci, the roots have infinite sensitivity. 
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Now, since the roots of Eq. (8-61) must also satisfy 
1 + KG,(s)H,(s) = 0 (8-71) 


or 
1 
——— 8-72 
G,(5)H,(s) ( ) 
it is simple to see that dK/ds = 0 is equivalent to 
dG (s)H(s) _ E 
ae =0 (8-73) 


It is important to point out that the condition for the breakaway point given 
by Eq. (8-73) is necessary but not sufficient. In other words, all breakaway points 
must satisfy Eq. (8-73), but not all solutions of Eq. (8-73) are breakaway points. 
To be a breakaway point, the solution of Eq. (8-73) must also satisfy Eq. (8-71); 
or, Eq. (8-73) must be a factor of Eq. (8-71) for some real K. 

In general, the following conclusions can be made with regard to the solu- 
tions of Eq. (8-73): 


1. All real solutions of Eq. (8-73) are breakaway points on the root 
loci (co < K < oo), since the entire real axis of the s-plane is 
occupied by the complete root loci. 

2. The complex-conjugate solutions of Eq. (8-73) are breakaway 
points only if they also satisfy Eq. (8-1). This uncertainty does not 
cause difficulty in the effective use of Eq. (8-73), since the other 
properties of the root loci are usually sufficient to provide informa- 
tion on the general proximity of the breakaway points. This infor- 
mation may also be helpful in solving for the roots of a high-order 
equation, as a result of Eq. (8-60), by trial and error. 


The following examples are devised to illustrate the application of Eq. 
(8-60) for the determination of breakaway points on the root loci. 


EXAMPLE 8-10 Consider that it is desired to sketch the root loci of the second-order 
equation 
sis +2) + Ks +4) =0 (8-74) 


Based on some of the theorems on root loci, the root loci of Eq. (8-74) are easily 
sketched, as shown in Fig. 8-12. It can be proven that the complex part of the loci is 
described by a circle. The two breakaway points are all on the real axis, one between 
0 and —2 and the other between —4 and —co. 

When we divide both sides of Eq. (8-74) by s(s +- 2) (the Golden Rule), we obtain 
the identity 
(s + 4) 


GMS) = 5573) (8-75) 
Therefore, from Eq. (8-60), the breakaway points must satisfy 
dG\(s)H\(s) __ s(s +2) — As + DG+4) _ 
dO Hs + 2p = (8-76) 
or 
s?+8s4+8=0 (8-77) 


Solving Eq. (8-77), we find that the two breakaway points of the root loci are at s = 
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K=+t0 K<0 K=0 K=0 K<0Q K>-© 


Fig. 8-12. Root loci of s(s + 2) + K(s +4) =0. 


—1.172 and s = —6.828. Note also that the breakaway points happen to occur all on 
the root loci (K > 0). 


EXAMPLE 8-11 Consider the equation 


s? + 2s4+2+4 K(s +2) =0 (8-78) 

The equivalent G(s)H(s) is obtained by dividing both sides of Eq. (8-78) by s? + 2s + 2, 
= K+ 2) 

AHS) = IS FS GP) 


Based on the poles and zeros of G(s)H(s), the complete root loci of Eq. (8-78) 
are sketched as shown in Fig. 8-13. The diagram shows that both the root loci and the 
complementary root loci possess a breakaway point. These breakaway points are 
determined from 

dG\(s)Hi(s)_ d (5 +2) 
ds ds s*+25+2 
_ s?+254+2—-25 +105 +2) __ 
>; (s? + 2s + 2)? f 


(8-80) 
0 
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Fig. 8-13. Root loci of s? + 2s + 2+ K(s+2)=0. 


or 
s?+45+2=0 (8-81) 


Upon solving Eq. (8-81), the breakaway points are found to be at s = —0.586 
and s = —3.414, Notice that in this case s = —3.414 is a breakaway point on the root 
loci, whereas s = —0.586 is a breakaway point on the complementary root loci. 


EXAMPLE 8-12 Figure 8-14 shows the complete root loci of the equation 


S(s + 4)(s? + 4s + 20) + K =0 (8-82) 
Dividing both sides of Eq. (8-82) by the terms that do not contain K, we have 
a4 K = 
1 + G(s)A(s) = 1+ 35 + 4s? + 45 4+ 20) =0 (8-83) 
Since the poles of G(s)A(s) are symmetrical about the axes ¢ = —2 and w = O in the 


s-plane, the complete root loci of the equation are also symmetrical with respect to 
these two axes. 
Taking the derivative of G:(s)H,(s) with respect to s, we get 


d4G(s)Hi(s)_ 483 + 2452 4-725 + 80 0 (8-84) 
ds ~— [s(s + 4)(s? + 45 + 20)]? ~ 


or 
53 + 652 + 185 + 20 =0 (8-85) 
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Fig. 8-14. Complete root loci of s(s + 4)(s2 + 4s + 20) + K =: 0. 


Because of the symmetry of the poles of G(s)H(s), one of the breakaway points is 


easily determined to be at s = —2, The other two breakaway points are found by 
solving Eq. (8-85) using this information; they are s = —2 + /2.45 and s = —2 — 
j2.45, 


ExAMPLeE 8-13 In this example we shall show that the solutions of Eq. (8-60) do not 
necessarily represent breakaway points on the root loci. 
The complete root loci of the equation 


S(s? + 2s + 2) + K=0 (8-86) 


are shown in Fig. 8-15; neither the root loci nor the complementary root loci have any 
breakaway point in this case. However, writing Eq. (8-86) as 


{ K —: 
" s(s* + 2s + 2) 


14+ KG,(s)H,(s) = 1 0 (8-87) 
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Fig. 8-15. Complete root loci of s(s2 + 2s + 2)+ K=0. 
and applying Eq. (8-60), we have 


ds ™ ds s(s? - 2s +2) % (8-88) 


which gives 
3s? ++454+2=0 (8-89) 


The roots of Eq. (8-89) are s = —0.677 + 70.471 and s = —0.677 — j0.471. These two 
roots do not represent breakaway points on the root loci, since they do not satisfy Eq. 
(8-86) for any real values of K. Another way of stating this is that Eq. (8-89) is not a 
factor of Eq. (8-86) for any real K. 


Method 2. An algorithm for finding the breakaway points on the root 
loci (—co < K < oo) was introduced by Remec.!7 The method is derived from 
the theory of equations,’! and the proofs of its necessary and sufficient condi- 
tions are given in the literature. 
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The breakaway-point algorithm using a tabulation that resembles the 
Routh tabulation for stability study is described below: 


Let the equation for which the root loci are desired be written as 
F(s) = Ags + Ays™' +... +A4,-15 + 4, =0 (8-90) 


where Ay, A;,...,A,-1, A, are constant coefficients and the variable 
parameter K is considered to be contained in the coefficients. 


. Obtain the function F’(s) which is the derivative of F(s) with respect 


to s. Let F’(s) be of the form 
F’(s) = Bys""! + Bs"? + ...+ B,_.5 + B,-, =9 (8-91) 
where By = nA,, By = (n — 1)A,,..., ete. 


. Arrange the coefficients of F(s) and F’(s) in two rows as follows: 


Ao A, Az see Ant A, 
Bo By, Bz, ... Br-1 90 


. Form the following array of numbers obtained by the indicated 


operations. Notice that this is not a Routh tabulation, although 
the cross-multiplication operation is the same as in the Routh 
tabulation. The illustrated tabulation is shown for a fourth-order 
equation, that is, for n= 4. Higher-order cases can be easily 
extended. 


A, Az A; Ag 
B, Bz B; 0 
Cy BoA2 — BrAo C= BoA3 — B3Ao C= BoA4 — AoO _ Ai 0 
Bo Bo Bo 
By By B; 0 
Di ~ ole Ai€s Dz Bots = B3Co D =F Se 0 0 
0 0 
E, =~ 2oB2 — D2Bo i DoB3 — D3Bo E; =:0 
: Do Do 
Dy D2 0 0 
R= Pole Paks F260 0 
G, = Fob Fe F2z,Do 
F; 
0 


Several important features of this tabulation must be mentioned at this 


1. 
2 
3 
4 
Ao 
Bo 
Co BoA ae 
Bo 
Do BoC poo 
Eo DoB ae 
Do 
oa E 
Fo= DoF a 0 
Go FyoD, a DoF, 
Fo 
FoG; — FiGo 
Ho Fo 
point. 


1. 


The s/ (j = 0, 1, 2,.. . , m) terms assigned to each row of the tabula- 
tion are used for reference purposes. 
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2. The s/ terms repeat for three consecutive rows for j = (n — 1),..., 
1. There is only one s° row and one s” row. 

3. If we regard the rows of coefficients in the tabulation that have the 
same s/ as a group, then it is noticed that the coefficients in the last 
row of a group are always a repeat of those in the first row of the 
same group. 


If F(s) has multiple-order roots, which means that the root loci will have 
breakaway points, a row of the tabulation shown above will contain all zero 
elements. In other words, the tabulation process will terminate prematurely. 
The multiple-order roots, which are the breakaway points, are obtained by 
solving the equation formed by using the row of coefficients just preceding the 
row of zeros. 

Let us use the following numerical examples to illustrate the application 
of the tabulation method of finding the breakaway points. 


EXAMPLE 8-14 Consider the equation 


F(s) = (s + 1)*(s + 2)? = s4 + 653 + 135? + 1254+4=0 (8-92) 


We have stated the problem in such a way that the equation is known to have two 
double roots at s = —1 and s = —2. Weare merely going to demonstrate the prop- 
erties of the tabulation when the multiple-order-root situation occurs. 

Taking the derivative on both sides of Eq. (8-92) with respect to s, we have 


Fs) = 4s? + 18s? + 26s + 12 =0 (8-93) 


The tabulation using the coefficients of F(s) and F’(s) is made in the following manner: 


s4 1 6 13 12 4 

s3 4 18 26 12 0 

53 AO — M08) _ 3 43) — M26 _ 13 @U2)—()02)_9 4 9g 
4 2 4 2 4 

53 4 18 26 12 0 

=} -i -4 

s2 6 18 12 

4 i -4 

s! 0 0 0 


Since there is a row of zero elements in the tabulation before the tabulation process 
is completed, this indicates that the equation F(s) has multiple-order roots. The equa- 
tion that needs to be solved is formed with the coefficients taken from the row just 
above the row of zeros. The order of the equation is given by the power of s in the 
reference column. Therefore, we have 


3s-—4=0 (8-94) 
or 
s?+35+2=0 (8-95) 


The roots of Eq. (8-95) are s = —1 and s = —2, which are the roots of F(s) with 
multiple order. 
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EXAMPLE 8-15 _ Let us consider a root locus problem, that is, the determination of the 
breakaway points on the root loci. The equation, Eq. (8-74), con- 
sidered in Example 8-10 will be used here. The equation is rewritten 


F(s) = s? +(2+ K)s + 4K =0 (8-96) 
Then 
F(s) =2s+ (24+ K)=0 (8-97) 
The following tabulation is made: 


52 1 2+K 4K 
si 2 2+ K 
sl 21K 4K 
sl 2 2+K 0 
s ax = 2+ XY ) 
4 
None of the rows can be made to contain all zeros except the last one. Then, we 
set 
2: 
4x —@2+KY 1m =0 (8-98) 
or 
—K2+12K —4=0 (8-99) 
Solving for K from the last equation, we have 
K = 0.344 
and 
K = 11.656 


When K equals either one of these two values, the s° row of the tabulation will 
contain all zeros, thus signifying a multiple-order root for F(s). The equation from 
which the roots or breakaway points can be obtained is formed by using the coefficients 
in the row preceding the s° row. The equation thus formed is 


2s5+(2+K)=0 (8-100) 
Now substituting K = 0.344 and K = 11.656 into Eq. (8-100) in turn, we find the 
two breakaway points on the root loci at 
s = —1.172 K = 0.344 
and 
Ss = —6,828 K = 11.656 
It is apparent that these answers agree with those obtained in Example 8-10. Further- 
more, a by-product of the tabulation method is that the values of K at the breakaway 


points are also determined. In fact, the values of K are always determined first before 
the breakaway points are found. 


EXAMPLE 8-16 Now consider the root locus problem of Example 8-12. Equation 
(8-82) is written as 
F(s) = s* + 853 + 36s? + 80s +-K =0 (8-101) 


The root loci of Eq. (8-101) have three breakaway points at s = —2, —2 + /2.45, and 
—2 — j2.45. Let us now determine the breakaway points by the tabulation method. 
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We have 
F'(s) = 4s3 + 24s? + 72s +- 80 = 0 (8-102) 
or 
s3 + 6s? + 18s +20 =0 (8-103) 


The following tabulation is made: 


s4 1 8 36 80 K 
33 1 6 18 20 
53 2 18 60 K 
33 1 6 18 20 
$2 6 24 K — 40 0 
$2 2 13 —< _ 40 20 0 
92 6 24 K — 40 0 
3! 10 ~ X z 40 20 — ee 0 0 


We would like to interrupt the tabulation at this point to remark that the elements 
in the first row of the s! group can be made zero by setting K = 100. Therefore, F(s) 
has multiple-order roots when K = 100. The breakaway points are found from the 
equation 
6s? + 24s + (K — 40) = 0 K = 100 (8-104) 
or 
s? +45 +10=0 (8-105) 


Therefore, the two breakaway points occur at s = —2 + j2.45 and s = —2 — j2.45, 
which are the solutions of Eq. (8-105). 

In order to complete the tabulation, we must now consider that K 4 100, so that 
the coefficients in the subsequent row (the second row of the s! group) are finite. In 
fact, since the multiple-order roots at K = 100 are already determined, should there 
be any additional multiple-order roots, they would have to occur at different values of 
K than 100. Therefore, in the remaining three rows of tabulation it is implied that 
K # 100. Resuming the tabulation, we have 


s! 12 K —40 

s! 19 _K— 4% 7 ee Sa K #100 
: 3 

g0 K — 64 0 


Now the only row that can be all zero is the s° row, and only when K = 64. Therefore, 
the breakaway point is found by substituting K = 64 into 


(10 2k ~ *"s 4: (20 ate 5 *) ney (8-106) 


which gives 
s=—2 


An alternative way of completing the tabulation is to factor out the common 
factor 10 — (K — 40)/6 in the last row of the s! group, and the tabulation is as follows: 
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si 12 K — 40 

si 1 2 

s0 K — 64 0 
Therefore, the same results, K = 64 and s = —2, are obtained. 


EXAMPLE 8-17 In this example we shall show that the tabulation method actually 
indicates explicitly that the root locus diagram in Fig. 8-15, Example 
8-13, does not have any breakaway points. 
Equation (8-86) is written 
F(s) = 53 + 257 +25+ K=0 (8-107) 
Then 
F's) = 3s? +4s+2=0 (8-108) 


The following tabulation is, made: 


~ 33 1 2 2 K 
g2 3 4 2 
st 4 4 K 
s2 3 4 2: 
st $ K-$ 0 
gs! 1 — 2K 2 0 
gs! $ K-—$ 0 
9 (xq AN(y _ 21K 
mo 2 2(c-$)(1-2K) 0 


It is apparent that only the elements of the last row of the tabulation can be made 
zero for any K. Therefore, we set 


9 4 27K\ _ 
2-4(k-3)(1-“B¥) =0 (8-109) 
which is simplified to 
81K2 — 48K + 16=0 (8-110) 


However, there are no real values of K that will satisfy this equation. Therefore, the 
conclusion is that F(s) does not have any multiple-order roots, or the root loci do not 
have any breakaway points. 


Comparison of the two methods of calculation of breakaway points. 


1. The condition stated in Eq. (8-60) for the breakaway point is neces- 
sary but not sufficient. The method involves solving for the possible 
breakaway points as roots of Eq. (8-60). For higher-order systems 
with a large number of breakaway points, the amount of work 
involved in solving a higher-order equation in Eq. (8-60) may be 
excessive. 

2. The tabulation method gives a necessary and sufficient condition 
for the breakaway points. In general, the procedure still involves 
the solving of the roots of an equation, but the order of the equation 
may be lower than that involved in the first method. The tabulation 
method also gives the values of K at the breakaway points. 
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These methods also represent ways of solving for the multiple-order root 
of an equation. 


Calculation of K on the Root Loci 


Once the root loci have been constructed, the values of K at any point s, 
on the loci can be determined by use of the defining equation of Eq. (8-8); that 
is, 


1 
K|= 8-111 
Ae CACHE ae 
If G,(s)H,(s) is of the form shown in Eq. (8-11), Eq. (8-12) is written 
i [$1 + py | 
|K| = 4 (8-112) 
1. Is; + z,| 
or 


|K| product of lengths of vectors drawn from the poles of G,(s)H,(s) to s, 
~ product of lengths of vectors drawn from the zeros of G,(s)H,(s) to s, 
(8-113) 
Equations (8-112) and (8-113) can be evaluated either graphically or analyt- 
ically. Usually, if the root loci are already drawn accurately, the graphical 
method is more convenient. For example, the root loci of the equation 


5? + 25 -+2+ K(s+2)=0 (8-114) 
are shown in Fig. 8-16. The value of K at the point s, is given by 
— A-B - 
K= — (8-115) 


where A and B are the lengths of the vectors drawn from the poles of G(s) H(s) 
= K(s + 2)/(s? + 25+ 2) to the point s, and C is the length of the vector 
drawn from the zero of G(s)H(s) to s,. In the illustrated case s, is on the root 
loci, so K is positive. If s, is a point on the complementary root loci, K should 
have a negative sign. 

The value of K at the point where the root loci intersect the imaginary axis 
can also be found by the method just described. However, the Routh-Hurwitz 
criterion usually represents a more direct method of computing this critical 
value of K. 

The eleven rules on the construction of root locus diagrams described 
above should be regarded only as important properties of the root loci. Remem- 
ber that earlier it was pointed out [Eq. (8-11)] that the usefulness of most of 
these rules of construction depends on first writing Eq. (8-1) in the form 


(s + pis + Pr)... (8 + py) + K(s + 2,)(8 + 22)... (8 +2) = 0 (8-116) 


Then, except for extremely complex cases, these rules are usually adequate for 
the analyst to make a reasonably accurate sketch of the root loci just short of 
plotting them point by point. In complicated situations, one has to rely on 
a computer as a more practical means of constructing the root loci. 
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Fig. 8-16. Graphical method of finding the values of K on the root loci. 


The following example serves as an illustration on the application of the 
rules of construction of the root loci. 


ExaAMPLe 8-18 Consider the equation 


s(s + 5)(s + 6)(s? + 2s + 2) + K(s + 3) = 0 (8-117) 


The complete root loci (—co < K < oo) of the system are to be constructed. Using 
the rules of construction, the following properties of the root loci are determined: 


1. The K = 0 points on the complete root loci are at s =: 0, —5, —6, —1 + 


ji, and —1 —j1. Notice that these points are the poles of G(s)H(s), where 
K(s + 3) 


OHO) = SENG + NG? F 25 F 2 oo 
. The K = +00 points on the complete root loci are at s = —3, ov, 0, 


co, oo, which are the zeros of G(s)H(s). 


. There are five separate branches on the complete root loci. 
. The complete root loci are symmetrical with respect to the real axis of 


the s-plane. 


. The angles of the asymptotes of the root loci at infinity are given by [Eq. 


(8-33)] 
g, — Gk im _ 2k + In 
a am meh 


ere 5 0<K<o (8-119) 


for k = 0, 1, 2, 3. Thus the four root loci that approach infinity in the 
s-plane as K approaches +o should approach asymptotes with angles 
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of 45°, —45°, 135°, and —135°, respectively. The angles of the asymptotes 
of the complementary root loci at infinity are given by [Eq. (8-34)] 
2kn 2kn 


O,=— = ew <K<0 (8-120) 


Therefore, as K approaches —co, four complementary root loci should 
approach infinity along asymptotes with angles of 0°, 90°, 180°, and 270°. 
6. The intersection of the asymptotes is given by [Eq. (8-51)] 
b; —a, _ & poles of G(s)H(s) — & zeros of G(s)H(s) 
n—m n—m 
—_ @-—5—-6—-1+4+/jl —1—jl) —(—3) _ 25 
oe : 


OC, = 
(8-121) 


The results from these six steps are illustrated in Fig. 8-17. 


Fig. 8-17. Preliminary calculations of the root loci of s(s -++ 5)(s + 6)(s? 
+ 25+ 2) + K(s + 3) =0. 
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In general, the rules on the asymptotes do not indicate on which side 
of the asymptote the root locus will lie. Therefore, the asymptotes indi- 
cate nothing more than the behavior of the root loci as s — oo. The 
complete root loci portions can be correctly sketched as shown in Fig. 
8-17 only if the entire solution to the root loci problem is known. 

7. Complete root loci on the real axis: There are root loci (0 < K < co) 


on the real axis between s = 0 and s = —3, s == —5, and s = —6. 
There are complementary root loci (—co < K <0) on the remaining 
portion of the real axis, that is, between s = —3 and s = —5, and 5 = 
—6 and s = —oco (see Fig. 8-18). 
Jw 
s-plane =0 


K 
Complementary x jl 
root loci a, 
0 = 00 K=0\ K>-@ 
a ee 


Thee loci xX 


0 


Fig. 8-18. Complete root loci on the real axis of s(s + 5)(s -- 6)(s? + 2s 
+ 2) + K(@s + 3) =0. 


8. Angles of departure: The angle of departure, 6, of the root locus leaving 
the pole at —1 + /1 is determined using Eq. (8-13). fs; is a point on the 
root locus leaving —1 +71, and s, is very close to --1 + 71 as shown in 
Fig. 8-19, Eq. (8-13) gives 


[sy +3 —(/sy + foi +1 +71 + [5,5 +5 + /5,:+ 6 
+ /s, +1 —J1) = (2k + 1)180° (8-122) 


4 jw 


s-plane 


Fig. 8-19. Computation of angle of departure of the root loci of s(s + 5) 
(s + 6)(s2 + 2s + 2) + K(s + 3) = 0. 


Sec. 8.3 


10. 


Construction of the Complete Root Loci / 409 


or 

26.6° — (135° + 90° + 14° + 11.4° + 0) = (2k +1)180° (8-123) 
fork =0, +1, +2,.... 
Therefore, 

= —43,8° (8-124) 

Similarly, Eq. (8-14) is used to determine the angle of arrival of the com- 
plementary root locus arriving at the point —1 +1. If this angle is 
designated as 6’, it is easy to see that 6” differs from @ by 180°; that is, 


0’ = 180° — 43.8° = 136.2° (8-125) 


. The intersection of the root loci with the imaginary axis is determined by 


the Routh~Hurwitz criterion. Equation (8-117) is rewritten 
s> + 1354 + 5453 + 8252 + (60 + K)s + 3K =0 (8-126) 
The Routh tabulation is 


s5 1 54 60 + K 
s4 13 82 3K 
si 47.7 60 + 0.769K 0 
s? 65.6 — 0.212K 3K 0 
3940 — 105K — 0.163K2 0 0 
65.6 — 0.212K 
sO 3K 0 


For Eq. (8-126) to have no roots in the right half of the s-plane, the 
quantities in the first column of the Routh tabulation should be of the 
same sign. Therefore, the following inequalities must be satisfied: 


65.6 — 0.212K > 0 or K < 309 (8-127) 
3940 — 105K — 0.163K2 > 0 or K <35 (8-128) 
K>0 (8-129) 


Hence all the roots of Eq. (8-126) will stay in the left half of the s-plane 
if K lies between 0 and 35, which means that the root loci of Eq. (8-126) 
cross the imaginary axis when K = 35 and K = 0. The coordinate at the 
crossover point on the imaginary axis that corresponds to K = 35 is 
determined from the auxiliary equation 


A(s) = (65.6 — 0.212K)s? + 3K =0 (8-130) 
Substituting K = 35 into Eq. (8-130), we have 
58.2s2 + 105 = 0 (8-131) 
which yields 
s = +/1.34 


Breakaway points: Based on the information obtained from the preced- 
ing nine steps, a trial sketch of the root loci indicates that there can be 
only one breakaway point on the entire root loci, and the point lies 
between the two poles of G(s)H(s) at s = —5 and —6. In this case, since 
there is only one breakaway point for this fifth-order system, the value of 
Kat the point is obtained from the s° row of the breakaway-point tabula- 
tion, which would contain a total of 14 rows if carried out. In this case 
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it is actually easier to solve for the breakaway point by trial and error, 
since we know that the desired root is between —5 and —6. 
Applying dK/ds = 0 to Eq. (8-126) gives 
s> + 13.554 + 6653 + 1425? + 1235 + 45 =0 


After a few trial-and-error calculations, the root of the last equation that 
corresponds to the breakaway point is found to be s = —5.53. 


From the information obtained in these 10 steps, the complete root locus diagram 
is sketched as shown in Fig. 8-20. 


In this section we have described 11 important properties of the root loci. 
These properties have been regarded as rules when they are used in aiding the 


Fig. 8-20. Complete root loci of s(s + 5)(s + 6s? + 25 -+ 2) + K(s 
-+ 3) =0. 
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construction of the root locus diagram. Of course, there are other minor prop- 
erties of the root loci which are not mentioned here. However, in general, it is 
found that these 11 rules are adequate in helping to obtain a reasonably accurate 
sketch of the complete root loci just short of actually plotting them. 

For easy reference, the 11 rules of construction are tabulated in Table 8-1. 


Table 8-1 Rules of Construction of Root Loci 

1. K = 0 points The K = 0 points on the complete root loci are at 
the poles of G(s)H(s). (The poles include those at 
infinity.) 

2. K = +c points The K = +c points on the complete root loci are 
at the zeros of G(s)H(s). (The zeros include those at 
infinity.) 

3. Number of separate The total number of root loci is equal to the order 

root loci of the equation F(s) = 0. 
4, Symmetry of root The complete root loci of systems with rational 
loci transfer functions with constant coefficients are 
symmetrical with respect to the real axis of the s- 
plane. 
5. Asymptotes of root For large values of s, the root loci (K > 0) are 
loci as s —> oo asymptotic to straight lines with angles given by 
0, = (2k + 1)a 
n—m 
and for the complementary root loci (K < 0) 
_ kn 
oe n—m 
where k = 0,1,2,..., |” — m|— 1. 
6. Intersection of the (a) The intersection of the asymptotes lies only on 
asymptotes the real axis in the s-plane. 
(centroids) (b) The point of intersection of the asymptotes on 
the real axis is given by (for all values of K) 
> real parts of _ Direal parts of 
Gio poles of G(s)H(s) zeros of G(s)H(s) 
: n-m 
7. Root loci on the On a given section on the real axis in the s-plane, 
real axis root loci are found for K => 0 in the section only if 
the total number of real poles and real zeros of 
G(s)H(s) to the right of the section is odd. If the 
total number of real poles and zeros to the right of 
a given section is even, complementary root loci 
(K < 0) are found in the section. 
8. Angles of departure The angle of departure of the root locus (K > 0) 


and arrival 


from a pole or the angle of arrival at a zero of 
G(s)H(s) can be determined by assuming a point s1 
that is on the root locus associated with the pole, or 
zero, and which is very close to the pole, or zero, 
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Table 8-1 (Cont.) 


and applying the equation 
[G(s1)H(s1) = % [si tz — & /si + py 
1=1 i= 


== (2k + 1)x k=0, +1, +2,... 
The angle of departure or arrival of a complemen- 
tary root locus is determined from 


m n 

(G(s) H(s1) = a (si +z— 3 /sitpy 
is ji 

= 2kn k=0, +1, £2,... 


9. Intersection of the The values of w and K at the crossing points of the 
root loci with the root loci on the imaginary axis of the s-plane may 
imaginary axis be obtained by use of the Routh-Hurwitz criterion. 

The Bode plot of G(s)H(s) may also be used. 
10. Breakaway points The breakaway points on the complete root loci 
(saddle points) are determined by finding the roots of dK/ds = 0, 


or dG(s)H(s)/ds = 0. These are necessary condi- 
tions only. Alternatively, the breakaway points are 
determined from a tabulation using the coefficients 
of the characteristic equations F(s) -= 0 and F’(s) 
= 0. The conditions are necessary and sufficient. 


11. Calculation of the The absolute value of K at any point s; on the com- 
values of K on the plete root loci is determined from the equation 
root loci 1 

Ks 
k= TaGDAGD 


product of lengths of vectors drawn 
_ from the poles of G(s)H(s) to 51 

product of Jengths of vectors drawn 

from the zeros of G(s)H(s) to s1 


8.4 Application of the Root Locus Technique to the Solution 
of Roots of a Polynomial 


Although the root locus diagram is primarily intended for the portrayal of 
the trajectory of roots of a polynomial when a parameter, K, varies, the tech- 
nique may also be used for the solution of the roots of a polynomial when all 
the coefficients are known. The principle is best illustrated by an example. Con- 
sider that it is desired to find the roots of the polynomial 
F(s) = s3 + 3s? + 4s + 20=0 (8-132) 
To formulate this as a root locus problem, we should first convert Eq. 
(8-132) into the form of Eq. (8-4). Since Eq. (8-132) does not have a variable 
parameter K, the step of conversion is generally not unique. In other words, 
we can regard any one of the four coefficients of the polynomial as the parameter 
K. However, in general, the selection of a number of these coefficients as K will 
result in simpler construction of the root loci. In this case it is not difficult to 
see that it is more preferable to divide both sides of Eq. (8-132) by s3 + 3s. 
Thus Eq. (8-132) leads to 
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4s +5) _ : 

1 1 gues) (8-133) 
which is of the form of Eq. (8-4), with K = 4. Furthermore, it is apparent that 
the roots of Eq. (8-132) must also satisfy Eq. (8-133). Now the problem of solv- 
ing Eq. (8-132) becomes that of a root locus problem, based on the pole-zero 
configuration of 

_ K(s +5) : 

G(s)H(s) = Fees) (8-134) 

The desired roots are then found by setting K = 4. From a logistic standpoint, 

we have embedded a specific problem in a more general one by first solving for 
the solution to the general problem. 

The root locus diagram based on the function G(s)H(s) of Eq. (8-134) for 

positive K is shown in Fig. 8-21. When K = 4, the real root of Eq. (8-132) lies 

between —3 and —5, while the other two roots are complex with positive real 


jw 


s-plane 


Fig. 8-21. Root locus diagram for the solution of the roots of s3 + 352 
+ 4s + 20=0. 
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parts. A few trial-and-error steps easily established the real root to be at s = 
—3.495. Thus the complex roots are found to be at s = 0.2475 + j2.381 and 
§ = 0.2475 — 72.381. 


EXAMPLE 8-19 Consider the problem of finding the roots of 
s* + 553 + 257 +5+10=0 (8-135) 
Since this is a fourth-order polynomial, it is expected that the problem of solving for 


its roots will be more difficult than that of the last example. Let us first divide both 
sides of Eq. (8-135) by the first two terms of the equation; we have 


2s? + 0.58 +5) _ 


i ae gy oO (8-136) 
2 2 4.0.59 + 5) 
G(s)H(s) = Eis el K=2 (8-137) 


The root locus diagram based on the poles and zeros of G(s)H(s) is constructed as 
shown in Fig. 8-22 for co > K > 0. However, from this root locus diagram it is not 


jw 


~ > 8 


s-plane 


K=0 


— 0.25 + 72.22 


Fig. 8-22. Root locus diagram for the solution of the roots of s4 + 5s3 
+2s7+5+10=0. 
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clear where the roots are when K = 2. Next let us divide both sides of Eq. (8-135) by 
the first three terms of the equation; we have 


s+ 10 ~ 
1+ 3G 455-3) ~° 138) 
The root locus plot of 
Gs) HG) = — KE +10 r=4 (8-139) 


s*(s? + 5s + 2) 
with co > K > 0 is shown in Fig. 8-23. The purpose of constructing the second root 
locus diagram is to establish a cross reference between the two root locus diagrams, 
since the roots of Eq. (8-135) must be found at the same points on both diagrams. Com- 
paring the two root locus diagrams, we may conclude that if Eq. (8-135) has real roots, 
there must be two, and they must lie between —0.44 and —4.56 on the real axis. Once 
this range has been established, the real roots can be found by trial and error from 
Eq. (8-135). One real root is found to be at s = —1.575. Dividing both sides of Eq. 
(8-135) by (s + 1.575), we have the remainder, 


s3 + 3.42552 — 3.394s + 6.346 =0 (8-140) 
Now we repeat the procedure to find the roots of Eq. (8-140). Since one of the 
three roots must be real, we can reason that it must be to the right of s = —4.56 on 


Fig. 8-23. Root locus diagram for the solution of the roots of s+ + 5s3 
+ 2s?-+5+10=0. 
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the real axis. However, we may acquire more information on this root by dividing both 
sides of the equation by the first two terms. We have 


—3,394(s — 1.87) _ 
32(s + 3.425) 


K(s — 1.87) 
5*(s + 3.425) 


The complementary root loci of Eq. (8-140) with the G(s)H(s) of Eq. (8-141) are 
sketched in Fig. 8-24 for —co < K < 0. Investigation of this complementary root locus 


1-4 0 
or 


G(s)H(s) = K = —3.394 (8-141) 


Fig. 8-24. Root locus diagram for the solution of the roots of s3 + 3.42552 
— 3.3945 + 6.346 = 0. 


diagram and the root loci of Fig. 8-24 reveals that the real root must lie between —3.425 
and —4.56. To find the real root of Eq. (8-140), which is at s = --4.493, is a simple 
matter. The two complex roots are subsequently found to be at s = 0.534 + 1.057 
and s = 0.534 — 71.057. Thus the roots of Eq. (8-135) are now all determined: 

s = —1.575 

s = —4.493 

s = 0.534 + 71.057 

s = 0.534 — 1.057 


In summarizing, we have used two examples to illustrate the application 
of the root locus method to the solution of the roots of a high-order equation, 


F(s) =0 (8-142) 
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where F(s) is a polynomial in s. The general procedure is to convert the equation 
to be solved into the form | + G(s)H(s) = 0 by dividing both sides of the equa- 
tion by a certain appropriate portion of the equation. 

In other words, we should express Eq. (8-142) as 

P(s) + QO(s) = 0 (8-143) 
Then, G(s)H(s) = Q(s)/P(s), or G(s) H(s) = P(s)/Q(s). The selection of the poly- 
nomials P(s) and Q(s) from F(s) is more or less arbitrary, although in general 
the orders of P(s) and Q(s) should be close so that the root locus problem is made 
as simple as possible. In many circumstances it may be desirable to use more 
than one choice of division of F(s) into P(s) and Q(s). This will usually provide 
additional information on the location of some of the roots of the equation, so 
that the trial-and-error procedure can be simplified. Example 8-19 illustrates 
how this is done. 

In essence, the method of root finding presented here is that of utilizing 
the root locus technique to give an indication of the general location of some 
of the roots. The basic method of finding the exact roots is still cut-and-try. 
For high-order equations, and for equations only with complex roots, the root 
locus method of root finding may not be effective, and a computer solution is 
still the most preferable one. 


8.5 Some Important Aspects of the Construction of the Root Loci 


One of the important aspects of the root locus techniques is that for most con- 
trol systems with moderate complexity, the analyst or designer may conduct 
a quick study of the system in the s-plane by making a sketch of the root loci 
using some or all of the rules of construction. In general, it is not necessary to 
make an exact plot of the root loci. Therefore, time may be saved by skipping 
some of the rules, and the sketching of the root locus diagram becomes an art 
that depends to some extent on the experience of the analyst. 

In this section we shall present some of the important properties of the root 
loci which may be helpful in the construction of the root locus diagram. 


Effect of Adding Poles and Zeros to G(s)H(s) 


In Chapter 6 the effects of the derivative and integral control were illustrated 
by means of the root locus diagram. From the fundamental viewpoint we may 
investigate the effects to the root loci when poles and zeros are added to G(s) H(s). 


Addition of poles. In general we may state that adding a pole to the func- 
tion G(s) H(s) in the left half of the s-plane has the effect of pushing the original 
root loci toward the right-half plane. Although it is difficult to make a precise 
statement and provide the necessary proof, we can illustrate the point by several 
examples. 

Let us consider the function 


G(s)H(s) = a>0 (8-144) 


_K__ 
S(s + a) 
The zeros of | + G(s)H(s) are represented by the root locus diagram of Fig. 
8-25(a). These root loci are constructed based on the poles of G(s)H(s) at s = 0 


{b) 


(c) (d) 


Fig. 8-25. Root locus diagrams that show the effects of adding poles to 
G(s)H(s). 


418 
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and s = —a. Now let us introduce a pole at s = —5 so that 


K 
S(s -|- a)(s -+ b) 


Figure 8-25(b) shows that the additional pole causes the complex part of the 
root loci to bend toward the right half of the s-plane. The angles of the asymp- 
totes are changed from +90° to +60°. The breakaway point is also moved to 
the right. For instance, if a = | and b = 2, the breakaway point is moved from 
—0.5 to —0.422 on the real axis. If G(s)H(s) represents the loop transfer func- 
tion of a feedback control system, the system with the root loci in Fig. 8-25(b) 
may become unstable if the value of K exceeds the critical value, whereas the 
system represented by the root loci of Fig. 8-25(a) is always stable. Figure 
8-25(c) shows the root loci when another pole is added to G(s)H(s) at s = —c. 
The system is now of the fourth order, and the two complex root loci are moved 
farther to the right. The angles of the asymptotes of these two loci are +45°. 
For a feedback control system, the stability condition of the system becomes 
even more restricted. Figure 8-25(d) illustrates that the addition of a pair of 
complex-conjugate poles to the original two-pole configuration will result in 
a similar effect. Therefore, we may draw a general conclusion that the addition 
of poles to the function G(s)H(s) has the effect of moving the root loci toward 
the right half of the s-plane. 


G(s)H(s) = b>a (8-145) 


Addition of zeros. Adding zeros to the function G(s)H(s) has the effect of 
moving the root loci toward the left half of the s-plane. For instance, Fig. 8-26(a) 


(a) (b) 


Fig. 8-26. Root locus diagrams that show the effects of adding a zero to 
G(s)H(s). 
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Fig. 8-26 (Cont.). Root locus diagrams that show the effects of adding 
a zero toG(s)H(s). 


shows the root locus diagram when a zero at s = —5 is added to the function 
G(s)H(s) of Eq. (8-144), with 6 > a; the resultant root loci are bent toward the 
left and form a circle. Therefore, if G(s)H(s) represents the loop transfer function 
of a feedback control system, the relative stability of the system is improved 
by the addition of the zero. Figure 8-26(b) illustrates that a similar effect will 
result if a pair of complex-conjugate zeros is added to the function of Eq. (8-144). 
Figure 8-26(c) shows the root locus diagram when a zero at s == —c is added to 
the transfer function of Eq. (8-145). 


Effects of Movements of Poles and Zeros 


It was mentioned earlier that the construction of the root locus diagram 
depends greatly on the understanding of the principle of the technique rather 
than just the rigid rules of construction. In this section we show that in all 
cases the study of the effects of the movement of the poles and zeros of G(s)H(s) 
on the root loci is an important and useful subject. Again, the best way to 
illustrate the subject is to use a few examples. 
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(e)a=1 


Fig. 8-27 (Cont.). 


EXAMPLE 8-20 Consider the equation 


s2(s + a) + K(s + 6b) =0 (8-146) 
which is easily converted to the form of 1 + G(s)H(s) = 0, with 
__ K(s +5) 
G(s)H(s) == cea) (8-147) 


Let us set 6 = 1 and investigate the root loci of Eq. (8-146) for several values of a. 
Figure 8-27(a) illustrates the root loci of Eq. (8-146) with a = 10 and 6 = 1. The 
two breakaway points are found at s = —2.5 and —6.5. It can be shown that for arbi- 
trary a the nonzero breakaway points are given by 
sa 4 ; ee iva — 1a +9 (8-148) 
When a = 9, Eq. (8-148) indicates that the breakaway points converge to one point 
at s = —3, and the root locus diagram becomes that of Fig. 8-27(b). It is interesting 
to note that a change of the pole from — 10 to —9 equals a considerable change to the 
root loci. For values of a less than 9, the values of s as given by Eq. (8-148) no longer 
satisfy the equation in Eq. (8-146), which means that there are no finite, nonzero, break- 
away points. Figure 8-27(c) illustrates this case with a = 8. As the pole at s -= —a is 
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moved farther to the right, the complex portion of the root loci is pushed farther 
toward the right-half plane. When a = b, the pole at s = —aand the zero at —A cancel 
each other, and the root loci degenerate into a second-order one and lie on the imagi- 
nary axis. These two cases are shown in Fig. 8-27(d) and (e), respectively. 


EXAMPLE 8-21 Consider the equation 


s(s* + 25 + a) + K(s +2) =0 (8-149) 
which is converted to the form of 1 + G(s)H(s) = 0, with 
GCOH@GSe 4022) (8-150) 


s(s? -+- 2s + a) 


The objective is to study the complete root loci (—co < K < co) for various values of 
a(> 0). As a start, let a = 1 so that the poles of G(s)H(s) are at s = 0, —1, and —1. 
The complete root loci for this case are sketched in Fig. 8-28(a). By setting dG(s)H(s)/ds 
to zero, the breakaway points are found at s 0.38, —1, and —-2.618. 

As the value of @ is increased from unity, the two double poles of G(s)H(s) at 
s = —1 will move vertically up and down. The sketch of the root loci is governed 
mainly by the knowledge of the breakaway points. We can show that dG(s)H(s)/ds 
leads to 


S3+4s2+4s+a=0 (8-151) 


As the value of a increases, the breakaway points at s = —0.38 and s = —2.618 
move to the left, whereas the breakaway point at s = —1 moves toward the right. 
Figure 8-28(b) shows the complete root loci with @ = 1.12; that is, 


Cis) s(s? A 2 arr (8-152) 

Since the real parts of the poles and zeros of G(s)H(s) are not affected by the value 
of a, the intersect of the asymptotes is always at the origin of the s-plane. The break- 
away points when a == 1.12 are at s = —0.493, —0.857, and —2.65. These are obtained 
by solving Eq. (8-151). 

By solving for a double-root condition in Eq. (8-151) when a = 1.185, it can be 
shown that the two breakaway points that lie between s = 0 and s = —1 converge to 
a point. The root loci for this situation are sketched as shown in Fig. 8-28(c). 

When a is greater than 1.185, Eq. (8-151) yields one real root and two complex- 
conjugate roots. Although complex breakaway points do occur quite often in root loci, 
we can easily show in the present case that these complex roots do not satisfy the origi- 
nal equation of Eq. (8-149) for any real K. Thus the root loci have only one breakaway 
point, as shown in Fig. 8-28(d) for a = 3. The transition between the cases in Fig. 
8-28(c) and (d) should be apparent. 


8.6 Root Contour—Multiple-Parameter Variation 


The root locus technique discussed thus far is restricted to only one variable 
parameter in K. However, in many control systems problems, the effects of 
varying several parameters must be studied. For example, when designing 
a controller that is represented by a transfer function with poles and zeros, it is 
necessary to investigate the effects on the performance of the overall system 
when these poles and zeros take on various values. 
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In Section 8.5 the root locus diagrams of equations with two variable 
parameters are studied by assigning different values to one of the parameters. 
In this section the multiparameter problem is investigated through a more 
systematic method of embedding. When more than one parameter varies con- 
tinuously from — oo to oe, the loci of the root are referred to as the reat contours. 
It will be shown that the same conditions and rules of the root loci are still 
applicable to the construction of the root contours. 

The principle of the root contours can be illustrated by considering the 
equation 

Q(s) + K,P,(s) + K,P,(s) = 0 (8-153) 


where K, and K, are the variable parameters and Q(s), P,(s), and P,(s) are 
polynomials of s. The first step involves the setting of one of the parameters 
equal to zero. Let us set K, equal to zero. Then Eq. (8-153) becomes 


O(s) + K,P,(s) = 0 (8-154) 


The root loci of this equation may be obtained by dividing both sides of the 
equation (the Golden Rule) by Q(s). Thus 


K,P,(s) 
14+-LiY=0 8-155 
ACO} (8-155) 
or 
1 + G,(s)H,(s) = 0 (8-156) 
The construction of the root loci depends on the pole-zero configuration of 
G,(s)H,(s) = Ae (8-157) 


Next, we restore the value of K,, and again apply the Golden Rule to Eq. 
(8-153), with K, as the variable parameter. We have 


K,P,(s) 


1+ OG) K.P)” 


(8-158) 
or 

1 + G,(s)H,(s) = 0 (8-159) 
Now the root contours of Eq. (8-153) are constructed based upon the poles and 
zeros of 

K,P,(s) 

O(s) + K,P,(s) 
However, one important feature is that the poles of G,(s)H,(s) are identical to 
the roots of Eq. (8-156) or of Eq. (8-154). Thus the root contours of the original 
equation must all start (K, = 0) at the points that lie on the root loci of Eq. 
(8-156). This is the reason why one root contour problem is considered to be 
embedded in another. The same procedure may be extended to more than two 
variable parameters. 


G,(s)H2(s) = 


(8-160) 


EXAMPLE 8-22 Consider the equation 
s3+ Kys? + Kis + K; =0 (8-161) 


where K, and K2 are the variable parameters and with values that lie between 0 and oo. 
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As a first step we let K, = 0; Eq. (8-161) becomes 


si+ Kis+ K,; =0 (8-162) 
which is converted to 


K,(s zs 10} =—-0 
AY 


1+ (8-163) 


The root loci of Eq. (8-162) are drawn from the poles and zeros of 


Ki(s + 1) 
me ae) 


G,(s)H,(s) = (8-164) 


as shown in Fig. 8-29(a). 
Next, we let K, vary between zero and infinity while holding K, at a constant 

nonzero value. Dividing both sides of Eq. (8-161) by the terms that do not contain K2, 

we have 

Kis 2 


Pr eK 


0 (8-165) 
Thus the root contours of Eq. (8-161) when K, varies may be drawn from the pole-zero 
configuration of 

Ky? 


G2(s)H2(s) = ae ACEOR A 


(8-166) 


(a) 


Fig. 8-29. (a) Root contours for s3 -+ Kos? + Kis + Ki =0, Kr =0 


Sec. 8.6 Root Contour—Multiple-Parameter Variation / 429 


s-plane 


K, =0(0.4+/1.74) 
I KK, =2.56 


/ K, =0.25 
Ky = 0 (0.1665 + 70.318) 
! Kk, =0.0184 


(b) 


Fig. 8-29 (Cont.). (6) Root contours for s3 + K2s2 + Kis + K, =0. 
K2 varies, K; = constant. 


The zeros of G2(s)H2(s) are at s = 0,0; but the poles are the zeros of 1 + 
G,(s)H;(s) which have been found on the contours of Fig. 8-29(a). Thus for fixed Ki 
the root contours when K, varies must all emanate from the root contours of Fig. 
8-29(a). 


EXAMPLE 8-23 Consider the loop transfer function 


K 


G(s)H(s) = sl - Ts\(s? -- 2s + 2) 


(8-167) 


of a closed-loop control system. It is desired to construct the root contours of the 
characteristic equation with K and T as variable parameters. 
The characteristic equation of the system is written 


s(1 + Ts)(s? + 2s +2) + K =0 (8-168) 
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First, we shall set T equal to zero. The characteristic equation becomes 


s(s? +- 2s +2) +K=0 (8-169) 

The root contours of this equation when K varies are drawn based on the poles and 
zeros of 

Gi()H(s) = ——* (8-170) 


s(s? + 25 -+ 2) 
as shown in Fig. 8-30(a). 


s-plane 


-1t/l 


(a) (b) 


Fig. 8-30. (a) Root loci for s(s? + 2s + 2) + K = 0. (b) Pole-zero con- 
figuration of G2(s)H2(s) = [Ts2(s2 + 2s + 2)]/s(s2 + 2s + 2) + K]. 


For the root contours with T varying and K held constant, we write Eq. (8-168) as 


Ts*(s? + 25 -+- 2) | 
s(s2 + 254+ 2)+K 
Therefore, the root contours when 7 varies are constructed from the pole-zero 
configuration of G2(s)H2(s). When T = 0, the points on the root contours are at the 
poles of G2(s)H2(s), which are the points on the root loci of Eq. (8-169), as shown in 
Fig. 8-30(b) for K = 10. The T = co points on the root contours are at the zeros of 
G2(s)H2(s), and these are at s = 0,0, —1 +1, and —1 —/1. The root contours for 
the system are sketched in Figs. 8-31, 8-32, and 8-33 for three different values of K; 
when K = 0.5 and T = 0.5, the characteristic equation has a quadruple root at s = 
—1. 


1 + G2(s)A2(s) = 1 + 0 (8-171) 


EXAMPLE 8-24 As an example illustrating the effect of the variation of a zero of 
G(s)H(s), consider 


— KU + 7s) _ 
CHO) = Se Ts + D 
The problem may be regarded as a study of the effect of derivative control, as discussed 
in Section 6.7, on the root locations of the characteristic equation. 


The characteristic equation of the system is 
s(s + 1) + 2) + KU + Ts) =0 (8-173) 
Let us first consider the effect of varying the parameter K. Setting T = 0 in Eq. (8-173) 


(8-172) 
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Fig. 8-31. Root contours for s(1 + sT)(s? + 25+ 2)+ K=0; K> 4. 


Fig. 8-32. Root contours for s(1 + sT)(s2 + 2s Fig. 8-33. Root contours for s(1 + sT)(s2 + 25 
+2)+ K=0; K =0.5. +2)+ K=0;K <0.5. 
yields 
sis + 1s +2)4+ K=0 (8-174) 


which leads to 
K 


s(s + 1)(s + 2) = 


The root loci of Eq. (8-174) are sketched in Fig. 8-34, based on the pole-zero configu- 
ration of 


1+ 0 (8-175) 


K 


G(s) H,(s) = se FE DG FD (8-176) 
When T varies between zero and infinity, we write Eq. (8-173) as 
1 + Ga(s)Ha(s) = 1+ cBS 0 (8-177) 


ss+DGt2)+K 


432 / Root Locus Techniques Chap. 8 


o 
jw a 
7 
7 
7 
i OK= 20 
s-plane 7 0.425 + 72.235 


/ 


Fig. 8-35. Pole-zero configuration of G2(s)H2(s) = TKs/{s(s + 1)(s + 2) 
+ K], K = 20. 
The points that correspond to T = 0 on the root contours are at the roots of 
s(s + 1)(s + 2) + K = 0, whose loci are sketched as shown in Fig. 8-34. If we choose 


K = 20, the pole-zero configuration of G2(s)H,(s) is shown in Fig. 8-35. The root 
contours of Eq. (8-173) for 0 < T < ~ are sketched in Fig. 8-36 for three values of 
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Fig. 8-36. Root contours of s(s + 1)(s + 2) + K + KTs = 0. 


K. The intersection of the asymptotes of the root contours is obtained from Eq. (8-51); 
that is, 

_ —3.85 + 0.425 + 0.425 | 
ees ee 
Therefore, the intersection of the asymptotes is always at s = —1.5 because the sum 
of the poles of G2(s)H2(s) is always equal to —3, regardless of the value of K, and the 
sum of the zeros of G2(s)H,(s) is zero. 


om —1.5 (8-178) 
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The root contours shown in Fig. 8-36 verify the well-known fact that the derivative 
control generally improves the relative stability of the closed-loop system by moving 
the characteristic equation roots toward the left in the s-plane. The root contours also 
clearly indicate an important characteristic of the derivative control in that the band- 
width of the system is increased. In certain cases the contribution to the increase in 
bandwidth by increasing the value of T far exceeds the improvement made on the 
relative stability of the system. As shown in Fig. 8-36, for K = 20, the system is sta- 
bilized for all values of T greater than 0.2333. However, the largest damping ratio that 
the system can have by increasing T is approximately 30 per cent. 


8.7 Root Loci of Systems with Pure Time Delay*! 


In Chapter 5 we investigated the modeling of systems with pure time delays and 
pointed out that the time delay between signals at various points of a system 
can be represented by the exponential term e~7: as its transfer function, where 
T is the delay in seconds. Therefore, we shall assume that the characteristic 
equation of a typical closed-loop system with pure time delay may be written 


Os) + KP(s)eT? = 0 (8-179) 
where Q(s) and P(s) are polynomials of s. An alternative condition of Eq. 
(8-179) is 

1 + KG,(s)H,(s)e"7> = 0 (8-180) 
where 
G(s) = FS (8-181) 


Thus, similar to the development in Section 8.2, in order to satisfy Eq. (8-180), 
the following conditions must be met simultaneously: 


eT?1G,(s)H,(s)| = ral oo <K <0 (8-182) 
/G,(s)H,\(s) = (2k + Da + wT K>0 (8-183) 

/G,(s)H,\(s) = 2kx + wT K<0 (8-184) 

where s =o + jm and k =0, +1, +2,.... Note that the condition for any 


point s = s, in the s-plane to be a point on the complete root loci is given in 
Eqs. (8-183) and (8-184), which differ from the conditions of Eqs. (8-9) and 
(8-10) by the term wT. When T = 0, Eqs. (8-183) and (8-184) revert to Eqs. 
(8-9) and (8-10). Since q@ is a variable in the s-plane, the angular conditions of 
Eqs. (8-183) and (8-184) are no longer constant in the s-plane but depend upon 
the point at which a root of Eq. (8-179) may lie. Viewing the problem from 
another standpoint, it is recognized that if T = 0, given a value of K, there are 
only 1 points in the s-plane that will satisfy either Eq. (8-183) or Eq. (8-184), 
for all possible values of k, where n is the highest order of P(s) and Q(s). How- 
ever, for T ~ 0, the angular conditions in Eqs. (8-183) and (8-184) depend on @, 
which varies along the vertical axis in the s-plane. Thus, for a given K, there may 
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be more than 7 points which satisfy the angular conditions in the s-plane, as k 
takes on all possible integral values. In fact, there are an infinite number of 
these points, since Eq. (8-179), which is transcendental, is known to have an 
infinite number of roots. 

The difficulty with the construction of the root loci of Eq. (8-179) is that 
many of the rules of construction developed originally for systems without time 
delay are no longer valid for the present case. It is of interest to investigate how 
some of the rules of construction given in Section 8.3 may be modified to apply 
to the time-delay case. 


K = 0 Points 
Theorem 8-9. The K = 0 points on the complete root loci of Eq. (8-180) are 
at the poles of G,(s)H,(s) and a@ = —©o. 


Proof: Equation (8-182) is repeated, 
e169) = 797 (8-185) 
Thus, if K equals zero, s approaches the poles of G,(s)H,(s), or ao, which is 
the real part of s, approaches — co. 


The K = + Points 


Theorem 8-10. The K = +09 points on the complete root loci of Eq. (8-180) 
are at the zeros of G,(s)H,(s) and a = 0. 


Proof: Referring again to Eq. (8-185), the proof of this theorem becomes 
evident. 


Number of Branches on the Complete Root Loci 


The number of branches on the root loci of Eq. (8-179) is infinite, since 
the equation has an infinite number of roots. 


Symmetry of the Complete Root Loci 


The complete root loci are symmetrical with respect to the real axis of 
the s-plane. This is explained by expanding e~7* into an infinite series; then Eq. 
(8-179) again becomes a polynomial with a real coefficient but with infinite 
order. 


Asymptotes of the Complete Root Loci 


Theorem 8-11. The asymptotes of the root loci of Eq. (8-179) are infinite in 
number and all are parallel to the real axis of the s-plane. The intersects of the 
asymptotes with the imaginary axis are given by 

Nu 


a= (8-186) 


where N is tabulated in Table 8-2 for the various conditions indicated. 
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n = number of finite poles of G,(s)H,(s) 


m = number of finite zeros of G,(s)H,(s) 


Table 8-2 
n—m K = 0 Asymptotes K = +00 Asymptotes 
>0 Odd N = even integers N = odd integers 
= 0,42, +4,... = +1, :-£3,45,... 
Even N = odd integers N = odd integers 
= +1, +3,+5,... = +1,:-43, +5,... 
<=0 Odd N = odd integers N = even integers 
= +1, +3, +5,... = 0, +2, -44,... 
Even N = even integers N = even integers 
Sr. 0, +2, +4, eae = 0, +2, £4, eae 


Proof: Since as s—» oo on the root loci, K either approaches zero or +00, 
Theorems 8-9 and 8-10 show that the asymptotes are at g = co (K = +00) 


and ¢ = — oo (K = 0). The intersections of the asymptotes with the je-axis and 
the conditions given in Table 8-2 are arrived at by use of Eqs. (8-183) and 
(8-184). 


Root Loci on the Real Axis 


The property of the root loci of Eq. (8-179) on the real axis is the same as 
stated in Theorem 8-7, because on the real axis, @ = 0, the angular conditions 
of Eqs. (8-183) and (8-184) revert to those of Eqs. (8-9) and (8-10), respectively. 


Angles of Departure and Arrival 


Angles of departure and arrival are determined by use of Eqs. (8-183) and 
(8-184). 


Intersection of the Root Loci with the Imaginary Axis 


Since Eq. (8-179) is not an algebraic equation of s, the intersection of its 
loci with the imaginary axis cannot be determined by use of the Routh-Hurwitz 
criterion. The determination of all the points of intersection of the root loci 
with the jq@-axis is a difficult task, since the root loci have an infinite number of 
branches. However, we shall show in the following section that only the inter- 
sections nearest the real axis are of interest for stability studies. 


Breakaway Points 


Theorem 8-12, The breakaway points on the complete root loci of Eq. (8-179) 
must satisfy 
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dG ,(s)H,(s)e"* —0 (8-187) 
ds 
Proof: The proof of this theorem is similar to that of Theorem 8-8. 
Determination of the Values of K on the Root Loci 


The value of K at any point s = s, on the root loci is determined from Eq. 
(8-182); that is, 


erm 
K\ =— SS 8-188 
IKI = EGG oe 
where g, is the real part of s,. 
EXAMPLE 8-25 Consider the equation 
s+ Ke-™s =0 (8-189) 


It is desired to construct the complete root loci of this equation for a fixed value of T. 
Dividing both sides of Eq. (8-189) by s, we get 


Ke-Ts 


1+ = 0 (8-190) 
which is of the form of Eq. (8-180) with 
Gi(s)Ai(s) = 4 , (8-191) 


The following properties of the root loci of Eq. (8-189) are determined: 


1. The K = 0 points: From Theorem 8-9, K = Oat s = 0 and at 0 = —oo. 
Using Theorem 8-11 and Table 8-2, we have 


K=>0: K approaches zero as 0 approaches —co atw = 0, +27/T, 
44n/T,... 


K<0: K approaches zero as 06 approaches —co at@ = +2/T, +32/T, 
+5n/T,... 


2. The K = +c points: From Theorem 8-10, K = +o ato = o, Using 
Theorem 8-11 and Table 8-2, we have 


K>0: K approaches +0oo as o approaches +0oo at @ = i2/T, 
4+32/T,... 


K<0: Kapproaches —co as 0 approaches +0o at@ = 0, +22/T, 
+4n/T,... 


The K = 0, K = +c points, and the asymptotes of the root loci are 
shown in Fig. 8-37. The notation of 0* is used to indicate the asymptotes 
of the root loci, and 07 is for the complementary root loci. 

3. The root loci (K => 0) occupy the negative real axis, and the complemen- 
tary root loci (K < 0) occupy the positive real axis. 

4, The intersections of the root loci with the j7@ axis are relatively easy to 
determine for this simple problem. 

Since G,(s)H,(s) has only a simple pole at s = 0, for any point s, on 
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Fig. 8-37. Asymptotes of the complete root loci of the equation s + Ke-Ts 
=0. 
the positive j@ axis, 
Tq 
[G(s )Hi(s1) = — > (8-192) 
and for any point s; on the negative j@ axis, 
T 
(Gils) Hi(s1) = z (8-193) 


Thus, for K => 0, Eq. (8-183) gives the condition of root loci on the j@ 
axis (@ > 0), 


-F = (2k +1)n + oT (8-194) 


k =0, +1, +2,...The values of @ that correspond to the points at which 
the root loci cross the positive j@ axis are 


_ k Sn ON 
= OP apap: (8-195) 
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For K > 0, and@ <0, 
5 = (2k + 1am + oT (8-196) 


and fork = 0, -k1, + 


2,..., the crossover points are found to be at 


sa OR Oe 
a7? oT? are 


o= (8-197) 


Similarly, for K < 0, the conditions for the complementary root loci 
to cross the j@ axis are 


— 5 =%na+@T @w>o0 (8-198) 


ue =U +@T w<0 (8-199) 


The crossover points are found by substituting A = 0, +1, +2,... into 
the last two equations. We have 


(8-200) 


. Breakaway points: The breakaway points on the complete root loci are 


determined by the use of Eq. (8-187). Thus 


dG \(s)Hy(s)e7Ts __ f(t = 3 
ds ~ ds\"s )=0 (e208) 
or 
—T —-Tse — e-Ts 
<j —<— =0 (8-202) 
from which we have 
eTTs +1) =0 (8-203) 
Therefore, the finite breakaway point is at s = —1/T. 


. The values of K at the crossover point on the j@ axis are found by using 


Eq. (8-188). Since ¢ = 0 on the j@ axis, we have 


= 1 
{G\J@,)A iM.) | 


where @, is a crossover point. 


|K| 


|, | (8-204) 


Based on the properties accumulated above, the complete root loci of Eq. (8-189) 
are sketched as shown in Fig. 8-38. 

Although the equation of Eq. (8-179) has an infinite number of roots, and there- 
fore the root loci have an infinite number of branches, from the system analysis stand- 
point, only the branches that lie between —2/T< @ <_2/T are of interest. We shall 
refer to these as the primary branches. One reason is that the critical value of K at the 
crossover point on this portion of the root loci is equal to 2/27, whereas the critical 
value of K at the next branch at @ = +52/2T is 51/2T, which is much greater. There- 
fore, K = 2/Tis the critical value for stability. Another reason for labeling the primary 
branches as the dominant loci is that for any value of K less than the critical value of 
n/2T, the corresponding roots on the other branches are all far to the left in the s-plane. 
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Fig. 8-38. Complete root loci for s + Ke-Ts = 0, 


Therefore, the transient response of the system, which has Eq. (8-189) as its character- 
istic equation, is predominantly controlled by the roots on the primary branches. 


EXAMPLE 8-26 As a slightly more complex problem in the construction of the root 
loci of a system with pure time delay, let us consider the control sys- 
tem shown in Fig. 8-39. The loop transfer function of the system is 

Ke-T 

G(s)H(s) = s¢ 


The characteristic equation is 
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Fig. 8-39. Feedback control system with a pure time delay in the feedback 
path. 


s? +s + Ke-Ts =O 


In order to construct the complete root loci, the following properties are assembled 
by using the rules given in Theorems 8-9 through 8-12. 


1. The K = 0 points: From Theorem 8-9, K =0 at s =0, s = —1, and 


o = —oo, Using Theorem 8-11 and Table 8-2, we have 

K>0: K approaches zero as o approaches —co at@ = +2/T, +3/2T, 
+5n/T,... 

K<0: K approaches zero as o approaches —co at @ =0, +22/T, 
+4n/T,... 


2. The K = +co points: From Theorem 8-10, K = +o at 0 = oo, Using 
Theorem 8-11 and Table 8-2, we have 


K>0: K approaches +co as o approaches +-co at w = +7/T, 


+32/T,... 
K<0: K approaches —oo as 0 approaches +c at @ = 0, +22/T, 
+4n/T,... 

Notice that the K = 0 asymptotes depend upon » — m, which is 
even in this case, but the K = + co asymptotes depend only on the sign 
of K and not on n — m. 

3. The root loci (K > 0) occupy the region between s = 0 and s = —1 on 


the real axis. The rest of the real axis is occupied by the complementary 
root loci (K < 0). 

4, Breakaway points: The breakaway points of the complete root loci are 
found from Eq. (8-187); that is, 


d{_e-Ts 
ds Fe +1 | ae 
from which we have the two breakaway points at 
al FEA 
s=57l-( + 2)4VT? + 4] 


For T = 1 sec the two breakaway points are at 
s = —0.382 5s = —2.618 
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Fig. 8-40. Complete root loci for s* + s + Ke-Ts = 0, T = 1. 


where it is easily verified that one belongs to the root loci, and the other 
is on the complementary root loci. 


The complete root loci of the system are sketched as shown in Fig. 8-40 for T = 1 
sec. Notice that from the system analysis standpoint, only the portion of the root loci 
that lies between @ = 2 and @ = —7 is of significance. The closed-loop system of 
Fig. 8-39 is stable for 0 < K < 1.157, Therefore, the other root loci branches, including 
the complementary root loci, are perhaps only of academic interest. 


Approximation of Systems with Pure Time Delay 


Although the discussions given in the preceding section point to a system- 
atic way of constructing the root loci of a closed-loop system with pure time 
delay, in general, for complex systems, the problem can still be quite difficult. 
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We shall investigate ways of approximating the time delay term, e~7*, by a poly- 
nomial or a rational function of s. One method is to approximate e~7*, as 
follows: 
rae i 

™ {lL + s/n)r 


Since e-7! has an infinite number of poles, the approximation is perfect when n 
becomes infinite. Figure 8-41 illustrates the effect of the approximation when 
the input to the pure time delay is a unit step function. 


-, = —_ 


= 


Fig. 8-41. Waveforms that illustrate the effect of approximating a pure 
time delay by finite number of poles. 


et (8-205) 


If Eq. (8-205) is used as the approximation for the root locus problem, only 
the primary branches of the root loci will be realized. However, this will be 
adequate for the great majority of practical problems, since only the primary 
branches will contain the dominant eigenvalues of the system. 

Let us approximate the exponential term of Eq. (8-189) by the right side of 
Eq. (8-205). Figure 8-42 illustrates the dominant root loci for n = 2, 3, and 
4; T = 1, together with the primary branch of the exact root loci. The approxi- 
mating root loci approach the exact ones as n becomes large. 

Another way of approximating the pure time delay transfer relation is to 
use a power series; that is, 


72s? 7353 
aaa ce | lea 


(8-206) 


The difference between this approximation and that of Eq. (8-205) is that 
in the former, the accuracy improves as the order n becomes larger, whereas in 
the present case, the validity of the approximation depends on the smallness of 
T. It is apparent that Eq. (8-206) can be conveniently applied if only a few 
terms of the series are used. 
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Fig. 8-42. Approximation of the root loci of s + Ke-* = 0 by those of 
(1 + s/n + K=0. 


8.8 Relationship Between Root Loci and the Polar Plot 


In Chapter 7 the polar plot of a transfer function G(s)H(s) is shown to be a map- 
ping of the imaginary axis of the s-plane onto the G(s)H(s) plane. In general, 
other trajectories in the s-plane can be mapped onto the G(s) #/(s)-plane through 
the function G(s)H(s), such as in the case of a system with pure time delay. 
Since the properties of the root loci depend upon the function G(s)A(s), we can 
regard the root loci as a mapping from the G(s)A(s) plane to the s-plane. Since 
the points on the complete root loci of the equation 
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1+ G(s)H(s) = 14+ KG,(s)H,(s) = 0 (8-207) 
satisfy the conditions 

KG,(s)H,(s) = (Qk + 1)x K>0 (8-208) 

KG,(s)H,(s) = 2kx K<0 (8-209) 


the root loci simply represent a mapping of the real axis of the G(s)A(s) plane 
onto the s-plane. In fact, for the root loci, K > 0, the mapping points are on 
the negative real axis of the s-plane; and for the complementary root loci, 
K < 0, the mapping points are on the positive rea] axis of the s-plane. 

It was shown in Chapter 7 that the mapping from the s-plane to the G(s) H(s) 
plane via the polar plot or the Nyquist plot is single-valued. In other words, 
a point @ = q@, on the imaginary axis of the s-plane is mapped onto only one 
point, G(jw,)A(ja,), in the G(s)H(s)-plane. However, in the root locus case, 
which is a reverse process, the mapping is multivalued. As an illustration, the 
polar plot of a type 1 transfer function of the third order is shown in Fig. 8-43. 


jlmGH jw 
G(s)H(s)-plane s-plane 


Fig. 8-43. Polar plot of G(s)H(s) = K/[s(s + a)(s + b)] interpreted as a 
mapping of the j@ axis of the s-plane onto the G(s)H(s)-plane. 


The entire polar plot in the G(s)H(s) is interpreted as the mapping of the entire 
ja axis of the s-plane. The complete root locus diagram for the same system is 
shown in Fig. 8-44 as a mapping of the real axis of the G(s)H(s)-plane onto 
the s-plane. Note that in this case each point of the G(s)H(s)-plane corresponds 
to three points in the s-plane. For instance, the (—1, 70) point of the G(s)H(s)- 
plane corresponds to the two points where the root loci intersect the ja axis 
and a point on the real axis. 

The polar plot and the root loci each represents the mapping of only a very 
limited portion of one domain to the other. In general, it would be useful to 
consider the mapping of points other than those on the jq@ axis of the s-plane and 
on the real axis of the G(s)H(s)-plane. For instance, we may use the mapping 
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Fig. 8-44. Root locus diagram of G(s)H(s) = K/[s(s + a)(s + 5)] inter- 
preted as a mapping of the real axis of the G(s)H(s)-plane onto the s-plane. 


of the constant-damping-ratio lines onto the G(s)H(s)-plane for the purpose of 
determining relative stability of the closed-loop system. Figure 8-45 illustrates 
the G(s)H(s) plots that correspond to different constant-damping-ratio lines in 
the s-plane. As shown by curve (3) in Fig. 8-45, when the G(s)H(s) curve passes 


jim GH jw 


G(s)H(s)-plane s-plane 


A root of the 
characteristic equation 


Fig. 8-45. G(s)H(s) plots that correspond to constant-damping ratio lines 
in the s-plane. 


Sec. 8.9 Root Loci of Discrete-Data Control System / 447 


through the (—1, /0) point, it means that Eq. (8-207) is satisfied, and the corre- 
sponding trajectory in the s-plane passes through a root of the characteristic 
equation. Similarly, we may construct root loci that correspond to straight 
lines rotated at various angles from the real axis in the G(s)H(s)-plane, as shown 
by Fig. 8-46. Notice that these root loci now satisfy the condition of 


/KG,(s)H,(s) = (2k + Da — 0 K>0. (8-210) 

Or, the root loci of Fig. 8-46 satisfy the equation 
1+ G(s)H(s)e” = 0 (8-211) 

for the various values of @ indicated. 
jw 


jim GH 


G(s)H(s}-plane 


s-plane 


Fig. 8-46. Root loci that correspond to different phase-angle loci in the 
G(s)H(s)-plane. (The complementary root loci are not shown.) 


It is of interest to note that Eq. (8-210) is very similar to the condition 
of Eq. (8-183), which is for the root loci of systems with pure time delays. 
In Eq. (8-183), the angle that is added to (2k + 1)a is a function of the fre- 
quency ow. 


8.9 Root Loci of Discrete-Data Control System‘*7~*° 


The root locus technique for continuous-data systems can be readily applied 
to discrete-data systems without requiring any modifications. The characteristic 
equation roots of the discrete-data system having the block diagram of Fig. 8-47 


448 / Root Locus Techniques Chap. 8 


Fig. 8-47. Discrete-data control system. 


must satisfy 
1+ GH*(s)=0 (8-212) 


if the roots are defined in the s-plane, or 


1+ GH(z) =0 (8-213) 


if the z-plane is referred to. 
Since 


GH"(s) = DY, Os + jna)H(s + jn.) (8-214) 


which is an infinite series, the poles and zeros of GH*(s) in the s-plane will be 
infinite in number. This evidently makes the construction of the root loci of Eq. 
(8-212) more difficult, However, as an illustrative example of the difference 
between the characteristics of the root loci of continuous-data and discrete- 
data systems, let us consider that for the system of Fig. 8-47, 


_ _K : 
G(s)H(s) = co) (8-215) 
Using Eq. (8-214), we have 
GH) =i ¥ ee eon (8-216) 
T némo(s + jnw,)s + jnw, + 1) 
which has poles at s = —jnw, and s = —1 — jnw,, where n takes on all integers 


between — co and co. The pole configuration of GH*(s) is shown in Fig. 8-48(a). 
Using the rules of construction outlined earlier, the root loci of | + GH*(s) = 0 
for positive K are drawn as shown in Fig. 8-48(b) for T = 1. The root loci con- 
tain an infinite number of branches, and these clearly indicate that the closed- 
loop system is unstable for all values of K greater than 4.32. [n contrast, it is 
well known that the same system without sampling is stable for all positive 
values of K. 

The root locus problem for discrete-data systems is simplified if the root 
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Fig. 8-48. Pole configuration of GH *(s) and the root locus diagram in the 
s-plane for the discrete-data system in Fig. 8-47 with G(s)H(s) = 
K/{s(s + 1)], T = 1 sec. 


loci are constructed in the z-plane using Eq. (8-213). Since Eq. (8-213) is, in 
general, a polynomial in z with constant coefficients, the number of root loci is 
finite, and the same rules of construction for continuous-data systems are directly 
applicable. 

As an illustrative example of the construction of root loci for discrete-data 
systems in the z-plane, let us consider the system of Fig. 8-47 with T = 1 sec, 
and G(s)H(s) as given by Eq. (8-215). Taking the z-transform of Eq. (8-215), 
we have 

0.632Kz 
(z — 1)(z — 0.368) 


which has a zero at z = 0 and poles at z = | and z = 0.368. The root loci for 
the closed-loop system are constructed based on the pole-zero configuration of 
Eq. (8-217) and are shown in Fig. 8-49. Notice that when the value of K exceeds 
4.32, one of the roots of the characteristic equation moves outside the unit 
circle in the z-plane, and the system becomes unstable. 


GH(z) = 


(8-217) 
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Fig. 8-49. Root locus diagram of discrete-data control system without 
zero-order hold. G(s)H(s) = K/[s(s + 1)], T = 1 sec. 


jilmz 


z-plane 


Fig. 8-50. Root locus diagram of discrete-data controi system without 
zero-order hold. G(s)H(s) = K/[s(s + 1)], T = 5 sec. 


For the same system, if the sampling period is changed to T = 5 sec, the z- 
transform of G(s)H(s) becomes 
0.993Kz 
CH) = ——1yG — 0.0067) 


(8-218) 
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The root loci for this case are drawn as shown in Fig. 8-50. It should be noted 
that although the complex part of the root loci for T = 5 sec takes the form of 
a smaller circle than that when T = 1 sec, the system is actually less stable. 
The marginal value of K for stability for T = 5 sec is 2.02 as compared to the 
marginal K of 4.32 for T = 1 sec. 

The constant-damping-ratio path*® may be superimposed on the root 
loci to determine the required value of K for a specified damping ratio. In 
Fig. 8-49 the constant-damping-ratio path for ¢ = 0.5 is drawn, and the 
intersection with the root loci gives the desired value of K = 1. Thus for all 
values of K less than 1, the damping ratio of the system will be greater than 50 
per cent. 

As another example, let us consider that a zero-order hold is inserted 
between the sampler and the controlled process G(s) in the system of Fig. 8-47. 
For the loop transfer function of Eq. (8-215), the z-transform with the zero-order 
hold is 


_ KUT — 1+ ez — Te + 1—e7) 
GioGH(z) = eee SS (8-219) 


The root loci of the system with sample-and-hold for T = 1 sec and T = 5 
sec are shown in Fig. 8-51(a) and (b), respectively. In this case the marginal 


jImz 


(a) Root loci for T= 1 sec 


Fig. 8-51. Root locus diagrams of discrete-data control system with sam- 
ple-and-hold. G(s)H(s) = K/[s(s + 1)]. (a) Root loci for T = 1 sec. (b) 
Root loci for T = 5 sec. 
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(b) Root loci for T= 5 sec 


Fig. 8-51 (Cont.). 


value of stability for K is 2.3 for T= 1 sec and 0.66 for T = 5 sec. This illus- 
trates the well-established fact that the zero-order hold reduces the stability 
margin of a discrete-data system. 
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PROBLEMS 


8.1. Sketch the root locus diagram for each of the following feedback control sys- 
tems. In each case determine everything about the locus of roots for —co < 
K < o and sketch the root loci. Indicate on each locus the starting point, the 
ending point, and the direction of increasing value of K. The poles and zeros 
of G(s)H(s) of the systems are given as follows: 
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8.2. 


8.3. 


8.4. 


8.5. 


8.6. 


8.7. 


(a) Poles at 0, —2, and —3; zero at —5. 

(b) Poles at 0,0, —2, and —3; zero at —5. 

(c) Poles at —2 + j2, and —2 —j2; zero at —3. 

(d) Poles at 0, —10 + 710, and —10 — j10; zero at —20. 

(e) Poles at 0, —20, —10 + 10, and —10 — 10; no finite zeros. 
(f) Poles at —20, —10 +10, and —10 — /10; zero at —30. 

(g) Poles at 0,0, —12, and —12:; zeros at —4 and —8. 


The open-loop transfer function of a unity-feedback control system is given by 


K(s + 3) 
s(s* +- 2s + 2)(s + 5)(s +6) 
(a) Sketch the root locus diagram as a function of K(—co < K < ©). 
(b) Determine the value of K that makes the relative damping ratio of the 
closed-loop complex poles equal to 0.4. 


G(s) = 


A unity feedback control system has an open-loop transfer function 


G(s) — KG + 0.25)\1_+ 0.025) 
5%(1 + 0.001s)(1 + 0.0055) 


Sketch the complete (—co < K < co) root locus diagram for the system. Indi- 
cate the crossing points of the loci on the j@ axis, and the corresponding values 
of K and @ at these points. 


A unity feedback control system has an open-loop transfer function 


be K 

OS) = SF 00IsT + 00is) 

(a) Sketch the root locus diagram of the system (0 < K < 00), 

(b) Determine the marginal value of K that will cause instability. 
(c) Determine the value of K when the system is critically damped. 


The transfer functions of a feedback control system are given as 


ee, See 
s*(s + 2)(s + 5) 


(a) Sketch the root locus diagram for the system. Indicate the crossing points 
of the loci on the j@ axis and the corresponding values of K and @ at these 
points (positive values of K only). 

(b) The transfer function of the feedback loop element is now changed to 
H(s) = 1 + 2s. Determine the stability of the modified system as a function 
of K. Investigate the effect on the root locus diagram due to this change in 
As). 


The characteristic equation of a feedback control system is given by 
s3 4+ 3s? + (K + 2)s + 10K =0 


G(s) = and A(s) = 1 


Sketch the root locus diagram (positive K only) for this system. 


For the following loop transfer function, sketch the root locus diagram as a 
function of T (T varies from 0 to cc), Determine the value of T so that the 
damping ratio of the complex roots of the characteristic equation is 0.2. 


100011 + 7s) 


G(S)H(9) = SEF O.s\d + 0.0015) 
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8.8. For the following loop transfer function, sketch the root locus diagram as a 
function of T. Determine the value of T so that the damping ratio of the complex 
roots of the characteristic equation is 0.2. 
30 
si + 0.18) + 0.25) + Ts) 


8.9. For the bridged-T network of Fig. P8-9, 


G(s)H(s) = 


Cy 
+ + 
R R 
E, | C Ey 
Figure P8-9. 


(a) Sketch the root locus diagrams of the zeros and poles of E,/E, as a function 
of C, (C, varies from 0 to o). 
(b) Sketch the root locus diagrams of the zeros and poles of £,/E, as a func- 
tion of C,. 
8.10. The open-loop transfer function of a control system with positive feedback is 
given by 
K 
WF 45 +4) 


Sketch the root locus diagram of the system as a function of K (0 < K < ©), 


G(s) = 


8.11. It is desired that the closed-loop transfer function of a control system be 
C(s) 1 
R(s) ~~ (1 +. 0.03s)(1 + 0.25 + 0.0252) 
Determine the open-loop transfer function G(s) of the system. Assume that the 
system has unity feedback. 


8.12. Given the equation 
So +as?+Ks+ K=0 


It is desired to investigate the root loci of this equation for —co < K < co and 

for several values of a. 

(a) Sketch the root loci (—oo < K < oo) fora = 10. 

(b) Repeat for a = 3. 

(c) Determine the value of a so that there is only one nonzero breakaway point 
on the complete root loci. Sketch the loci. 

In sketching the root loci you should apply all known rules whenever they are 

applicable. 


8.13. The open-loop transfer function of a control system with unity feedback is given 
by 
_ K(s+a) 
HS) = +1) 
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Determine the values of a so that the root locus diagram will have zero, one, 
and two breakaway points, respectively, not counting the one at s = 0. Sketch 
the root loci for —co < K < co for all three cases. 

8.14. For the sampled-data control system shown in Fig. P8-14, 


K 
GS) = F025) 


Figure P8-14. 


(a) Sketch the root loci for the system (0 < K < 00) without the zero-order 
hold, for T = 0.1 sec and T = 1 sec. Determine the marginal value of K 
for stability in each case. 
(b) Repeat part (a) when the system has a zero-order hold. 
8.15. The following polynomial in z represents the characteristic equation of a certain 
discrete-data control system. Sketch the root loci (—co < K < co) for the 
system. Determine the marginal value of K for stability. 


z3 + Kz? + 1.5Kz —(K +1) =0 
8.16. Sketch the root loci (0 < K < co) in the z-plane for the discrete-data control 


system shown in Fig. P8-16. 
Ke —0.5s ; 
s(s + 1)(s +3) 


c(t) 


Figure P8-16. 
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Frequency-Domain Analysis 


of Control Systems 


9.1 Introduction 


It was pointed out earlier that in practice the performance of a feedback control 
system is more preferably measured by its time-domain response characteristics. 
This is in contrast to the analysis and design of systems in the communication 
field, where the frequency response is of more importance, since in this case 
most of the signals to be processed are either sinusoidal or periodic in nature. 
However, analytically, the time response of a control system is usually difficult 
to determine, especially in the case of high-order systems. In the design aspects, 
there are no unified ways of arriving at a designed system given the time-domain 
specifications, such as peak overshoot, rise time, delay time, and settling time. 
On the other hand, there is a wealth of graphical methods available in the 
frequency-domain analysis, all suitable for the analysis and design of linear 
feedback control systems. Once the analysis and design are carried out in the 
frequency domain, the time-domain behavior of the system can be interpreted 
based on the relationships that exist between the time-domain and the fre- 
quency-domain properties. Therefore, we may consider that the main purpose 
of conducting control systems analysis and design in the frequency domain is 
merely to use the techniques as a convenient vehicle toward the same objectives 
as with time-domain methods. 

The starting point in frequency-domain analysis is the transfer function. 
We shall first discuss transfer function relations based on, first, the state variable 
representation and, second, the classical approach. 

In Section 3.3 the transfer function of a multivariable closed-loop control 
system is derived. Referring to Fig. 3-9, the closed-loop transfer function matrix 
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relation is written [Eq. (3-44)] 
C(s) = [I + G(s)H(s)}-'G()R(s) (9-1) 


where C(s) isaq x 1 vector and R(s) isa p x 1 vector. The closed-loop transfer 
function matrix is defined as 


M(s) = [I + G(s)H(s)}-'G(s) (9-2) 


which is ag X p matrix. 
Under the sinusoidal steady state, we set s = ja; then Eq. (9-2) becomes 


M(jo) = [I + G(jo)H(io)-' Gio) (9-3) 
The ijth element of M(ja) is defined as 


C{jo) 
(Joo) R(jo) all other inputs=0 


where i represents the row and j the column of M(ja). 


State-Variable Representation 


For a system that is represented by state equations, 


x() = Ax(t) + Bu(s) (9-5) 
e(t) = Dx(2) + Eu(e) (9-6) 

For the present case we assume that the feedback is described by 
u(t) = r(t) — He(2) (9-7) 


where 
x(t) =n X | state vector 


u(t) = p X | control vector 
c(t) = q X | output vector 
r(t) = p X | input vector 


A, B, D, and E are constant matrices of appropriate dimensions, and H is the 
P X q feedback matrix. The transfer function relation of the system is 


C(s) = [D(sI — A)-'B + E]U(s) (9-8) 
The open-loop transfer function matrix is defined as 
G(s) = D(sl — A) 'B+E (9-9) 
The closed-loop transfer function relation is described by the equation 
C(s) = [1 + G(s)H)“'G(s)R(s) (9-10) 
Thus 
M(s) = [I + GG)H]-'G(s) (9-11) 


It should be noted that the matrix H in Eq. (9-11) has only constant elements. 
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In general, the elements of the transfer function matrices are rational func- 
tions of s. In Chapter 4 it is proved that if the system is completely controllable 
and observable, there will be no pole—zero cancellations in the transfer func- 
tions. Under this condition the poles of the transfer function will also be the 
eigenvalues of the system. 

The analysis techniques in the frequency domain discussed in the following 
sections are conducted with the single-variable notation. Because linear systems 
satisfy the principle of superposition, these basic techniques can all be applied 
to multivariable systems. 

For a single-loop feedback system, the closed-loop transfer function is 
written 
C(s) G(s) 


MS) = Rs) ~ T+ GHG) 


(9-12) 
Under the sinusoidal steady state, we set s = ja; then Eq. (9-12) becomes 


_\  Cljo) _ G(jo) : 
MU) = RG) — TF Ca) AGa) oo 


The sinusoidal steady-state transfer relation M(jw), which is a complex 
function of @, may be expressed in terms of a real and an imaginary part; that is, 


M( jaw) = Re [M(ja)] + j Im [M(jo)] (9-14) 


Or, M( ja) can be expressed in terms of its magnitude and phase as 


M(jo) = M(o)/bn(o) (9-15) 
where 
= G( jo) s 
M(@) =|; + G(jo)H(jo) oy 
and 


= G(ja) 
Pn(ca) = [ 1 + G(jo)H(jo) (9-17) 


= /G(jo) — /1 + Gjw)H(jo) 


Since the analysis is now in the frequency domain, some of the terminology 
used in communication systems may be applied to the present control system 
characterization. For instance, M(@) of Eq. (9-16) may be regarded as the 
magnification of the feedback control system. The significance of M(qw) to a 
control system is similar to the gain or amplification of an electronic amplifier. 
In an audio amplifier, for instance, an ideal design criterion is that the amplifier 
must have a flat gain for all frequencies. Of course, realistically, the design 
criterion becomes that of having a flat gain in the audio frequency range. In 
control systems the ideal design criterion is similar. If it is desirable to keep 
the output C(ja) identical to the input R(jq) at all frequencies, M( ja) must be 
unity for all frequencies. However, from Eq. (9-13) it is apparent that M(ja) 
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can be unity only when G(jq) is infinite, while H( ja) is finite and nonzero. An 
infinite magnitude for G( ja) is, of course, impossible to achieve in practice, nor 
would it be desirable, since most control systems become unstable when its 
loop gain becomes very high. Furthermore, all control systems are subjected to 
noise. Thus, in addition to responding to the input signal, the system should be 
able to reject and suppress noise and unwanted signals. This means that the 
frequency response of a control system should have a cutoff characteristic in 
general, and sometimes even a band-pass characteristic. 

The phase characteristics of the frequency response are also of importance. 
The ideal situation is that the phase must be a linear function of frequency 
within the frequency range of interest. Figure 9-1 shows the gain and phase 
characteristics of an ideal low-pass filter, which is impossible to realize phys- 
ically. Typical gain and phase characteristics of a feedback control system are 
shown in Fig. 9-2. The fact is that the great majority of control systems have 
the characteristics of a low-pass filter, so the gain decreases as the frequency 


increases, 
0 w 
M(w) a ae 
1 
$m () : 
Deg 
0 We w 
Fig. 9-1. Gain-phase characteristics of an ideal low-pass filter. 
M, " 
M(w) 0 ri 
1 
$m (w) 
Deg 
0 w 


Fig. 9-2. Typical gain and phase characteristics of a feedback control system. 


9.2 Frequency-Domain Characteristics 


If a control system is to be designed or analyzed using frequency-domain 
techniques, we need a set of specifications to describe the system performance. 
The following frequency-domain specifications are often used in practice. 
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Peak resonance M,. The peak resonance M, is defined as the maximum 
value of M(@) that is given in Eq. (9-16). In general, the magnitude of M, gives 
an indication of the relative stability of a feedback control system. Normally, 
a large M, corresponds to a large peak overshoot in the step response. For 
most design problems it is generally accepted that an optimum value of M, 
should be somewhere between 1.1 and 1.5. 


Resonant frequency ,. The resonant frequency q@, is defined as the fre- 
quency at which the peak resonance M, occurs. 


Bandwidth. The bandwidth, BW, is defined as the frequency at which the 
magnitude of M(ja), M(w), drops to 70.7 per cent of its zero-frequency level, 
or 3 dB down from the zero-frequency gain. In general, the bandwidth of a 
control system indicates the noise-filtering characteristics of the system. Also, 
bandwidth gives a measure of the transient response properties, in that a large 
bandwidth corresponds to a faster rise time, since higher-frequency signals are 
passed on to the outputs. Conversely, if the bandwidth is small, only signals 
of relatively low frequencies are passed, and the time response will generally be 
slow and sluggish. 


Cutoff rate. Often, bandwidth alone is inadequate in the indication of the 
characteristics of the system in distinguishing signals from noise. Sometimes it 
may be necessary to specify the cutoff rate of the frequency response at the high 
frequencies. However, in general, a steep cutoff characteristic may be accom- 
panied by a large M,, which corresponds to a system with a low stability margin. 

The performance criteria defined above for the frequency-domain analysis 
are illustrated on the closed-loop frequency response, as shown in Fig. 9-3. 

There are other criteria that may be used to specify the relative stability 
and performance of a feedback control system. These are defined in the ensuing 
sections of this chapter. 


Fig. 9-3. Typical magnification curve of a feedback control system. 
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9.3 M,, @,, and the Bandwidth of a Second-Order System 


For a second-order feedback control system, the peak resonance M,, the reso- 
nant frequency w,, and the bandwidth are all uniquely related to the damping 
ratio € and the natural undamped frequency w, of the system. Consider the 
second-order sinusoidal steady-state transfer function of a closed-loop system, 


ips CUO) ga OR 
1 


~ T+ p2@/o. — (ole,) 
We may simplify the last expression by letting u = w/w,. Then, Eq. (9-18) 


becomes 
; 1 
Mit) =e Fl we (9-19) 
The magnitude and phase of M(ja) are 
, 1 
| M(ju)| = M(u) = (0 — #)? -F Olay? (9-20) 
and 
ets -_ -, 2Cu 
/M(ju) = ¢,(u) = —tan faa (9-21) 


The resonant frequency is determined first by taking the derivative of M(u) 
with respect to u and setting it equal to zero. Thus 


ai) = — Fl — 2) + lw dut — du + Bul?) = 0 (9-22) 
from which 
4u3 — 4u + 8ul2 =0 (9-23) 
The roots of Eq. (9-23) are 
u,=0 (9-24) 
and 
up = /1— 22 (9-25) 


The solution in Eq. (9-24) merely indicates that the slope of the M(w) versus @ 
curve is zero at m = 0; it is not a true maximum. The solution of Eq. (9-25) 
gives the resonant frequency, 


Dp = War/l — 20? (9-26) 


Since frequency is a real quantity, Eq. (9-26) is valid only for 1 > 2¢? or 
€ < 0.707. This means simply that for all values of ¢ greater than 0.707, the 
solution of @, = 0 becomes the valid one, and M, = 1. 


M(u) 
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Substituting Eq. (9-25) into Eq. (9-20) and simplifying, we get 


1 
Ee 
It is important to note that M, is a function of { only, whereas q, is a function 
of € and a,. 

It should be noted that information on the magnitude and phase of M(ja) 
of Eq. (9-18) may readily be derived from the Bode plot of Eq. (A-51), Figs. 
A-10 and A-12. In other words, Fig. A-12 is an exact representation of Eq. 
(9-21). The magnitude of M(ja), however, may be represented in decibels versus 
frequency, which is the Bode plot in Fig. A-10, or it may be plotted in absolute 
magnitude, M(q), versus @. Figure 9-4 illustrates the plots of M(u) of Eq. (9-20) 


(9-27) 


u= w/w, 


Fig. 9-4. Magnification-versus-normalized frequency of a second-order 
closed-loop control system. 
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5 


| 
! 


0 0.5 0.707 1.0 15: 2.0 
Damping ratio ¢ 


Fig. 9-5. M,-versus-damping ratio for a second-order system, M, = 


1/(2EV1 — ¢2). 


versus u for various values of €. Notice that if the fre- 
quency scale were unnormalized, the value of w, would 
increase when € decreases, as indicated by Eq. (9-26). 
0.8 When ¢€ = 0, w, and @, become identical. Figures 9-5 

and 9-6 illustrate the relationship between M, and ¢, and 


3 06 u = q,/o, and ¢, respectively. 
> As defined in Section 9.2, the bandwidth, BW, of a 
Ne pea system is the frequency at which M(co) drops to 70.7 per 
ae cent of its zero-frequency value, or 3 dB down from the 
zero-frequency gain. Equating Eq. (9-20) to 0.707, we 
0.2 h 
ave 
1 
M(u) = 5 == 0.707 (9-28) 
0 0.5 0.707 1.0 (d — wy + 2ou)?}' 
Damping ratio ¢ Thus 
— y2)\2 2111/2 ~- 53 
Fig. 9-6. Normalized resonant frequency- (a u2y? + (2fu)?] V2 (9-29) 
versus-damping ratio for asecond-order This equation leads to 
= — f2 a 
ene Snes w= (1—20)+ JAFFE FS (9-30) 


In the last expression the plus sign should be chosen, since « must be a positive 
real quantity for any ¢. Therefore, from Eq. (9-30), the bandwidth of the 
second-order system is determined as 


BW = a, [(1 — 207) + ./464 — 402 + 2]! 7 (9-31) 

Figure 9-7 gives a plot of BW/a, as a function of ¢. It is of interest to note that 

for a fixed @,, as the damping ratio ¢ decreases from unity, the bandwidth 
increases and the resonance peak M, also increases. 

For the second-order system under consideration, we easily establish some 


simple relationships between the time-domain response and the frequency- 
domain response of the system. 
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Fig. 9-7. Bandwidth/w,-versus-damping ratio for a second-order system, 
BW = a,[(1 — 262) + /404 — 402 + 2)1/2, 


1. The maximum overshoot of the unit step response in the time domain 
depends upon € only [Eq. (6-96)]. 

2. The resonance peak of the closed-loop frequency response M, 
depends upon € only [Eq. (9-27)]. 

3. The rise time increases with ¢, and the bandwidth decreases with 
the increase of ¢, for a fixed w,, Eq. (6-102), Eq. (9-31), Fig. 6-14, 
and Fig. 9-7. Therefore, bandwidth and rise time are inversely 
proportional to each other. 

4. Bandwidth is directly proportional to @,. 

5. Higher bandwidth corresponds to larger M,. 


9.4 Effects of Adding a Zero to the OQpen-Loop Transfer Function 


The relationships established between the time-domain and the frequency- 
domain responses arrived at in Section 9.3 are valid only for the second-order 
closed-loop transfer function of Eq. (9-18). When other transfer functions or 
more parameters are involved, the relationships between the time-domain and 
the frequency-domain responses are altered and may be more complex. It is of 
interest to consider the effects on the frequency-domain characteristics of a 
feedback control system when poles and zeros are added to the open-loop 
transfer function. It would be a simpler procedure to study the effects of adding 


BW 3 


T 


Fig. 9-8, Bandwidth of a second-order system with open-loop transfer 
function G(s) = (1 + 7s)/{s(s + 1.414)]. 


~ (+75) 
OO) Tee 1.414) 


0 1 2 3 : 4 
w rad/sec 


Fig. 9-9. Magnification curves for a second-order system with an open- 
loop transfer function G(s). 
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M(w) 


0 1 2 3 4 


w rad/sec 


Fig. 9-10. Magnification curves for a second-order system with an open- 
loop transfer function G(s) = (1 + 7s)/[s(s + 90.4)). 


poles and zeros to the closed-loop transfer function. However, it is more realistic 
to consider modifying the open-loop transfer function directly. 

The closed-loop transfer function of Eq. (9-18) may be considered as that 
of a unity feedback control system with an open-loop transfer function of 


a? 
GS) = C5 Tod (9-32) 
Let us add a zero at s = —1/T to the last transfer function so that Eq. (9-32) 
becomes 
G(s) = on(1 + Ts) (9-33) 


s(s + 2Cea,) 


This corresponds to the second-order system with derivative control studied in 
Section 6.7. The closed-loop transfer function of the system is given by Eq. 
(6-156), and is repeated here: 


C(s) __ w2(1 + Ts) ‘ 
R(s) s?- + Qla, + Tw?2)s + a? (0-34) 


In principle, M,, w,, and BW of the system can all be derived using the 


M(s) = 


c(t) 


470 / Frequency-Domain Analysis of Control Systems Chap. 9 


1.2 


4 >) 6 7 8 9 


Time (seconds) 


Fig. 9-11. Unit step responses of a second-order system with an open-loop 
transfer function G(s) = (1 + Ts)/[s(s + 1.414)}. 


same steps as illustrated in Section 9.3. However, since there are now three 
parameters in ¢, @,, and T, the exact expressions for M,,, w,, and BW are 
difficult to obtain even though the system is still of the second order. For 
instance, the bandwidth of the system is 


BW = (— +5 VPF dann)" (9-35) 


where 
b = 47@?2 + 4603T — 2m? — wT? (9-36) 
It is difficult to see how each of the parameters in Eq. (9-35) affects the 
bandwidth. Figure 9-8 shows the relationship between BW and T for ¢ = 0.707 
and @, = 1. Notice that the general effect of adding a zero to the open-loop 
transfer function is to increase the bandwidth of the closed-loop system. How- 
ever, for small values of T over a certain range the bandwidth is actually 
decreased. Figures 9-9 and 9-10 give the plots for M(q) for the closed-loop 
system that has the G(s) of Eq. (9-33) as its open-loop transfer function; @, = 1, 
T is given various values, and ¢ = 0.707 and ¢ = 0.2, respectively. These curves 
show that for large values of 7 the bandwidth of the closed-loop system is 
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c(t) 


Time (second) 


Fig. 9-12. Unit step responses of a second-order system with an open-loop 
transfer function G(s) = (1 + 7s)/[s(s + 0.4)]. 


increased, whereas there exists a range of smaller values of T in which the BW 
is decreased by the addition of the zero to G(s). Figures 9-11 and 9-12 show the 
corresponding unit step responses of the closed-loop system. The time-domain 
responses indicate that a high bandwidth corresponds to a faster rise time. 
However, as T becomes very large, the zero of the closed-loop transfer function, 
which is at s = —1/T, moves very close to the origin, causing the system to have 
a large time constant. Thus Fig. 9-11 illustrates the situation that the rise time 
is fast but the large time constant of the zero near the origin of the s-plane 
causes the time response to drag out in reaching the final steady state. 


9.5 Effects of Adding a Pole to the Open-Loop Transfer Function 


The addition of a pole to the open-loop transfer function generally has the 
effect of decreasing the bandwidth of the closed-loop system. The following 
transfer function is arrived at by adding (1 + Ts) to the denominator of Eq. 
(9-32): 


On 
GO) = SEF aN + 75) le 
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Fig. 9-13. Magnification curves for a third-order system with an open- 
loop transfer function G(s) = 1/[s(s + 1.414)(1 + Ts)]. 


The derivation of the bandwidth of the closed-loop system which has the 
G(s) of Eq. (9-37) as its open-loop transfer function is quite difficult. It can be 
shown that the BW is the real solution of the following equation: 

T?a® + (1 + 4€2@2T*)oo* + (4672 — 202 — 4€@3T)wo? — wt = 0 (9-38) 

We may obtain a qualitative indication on the bandwidth properties by 
referring to Fig. 9-13, which shows the plots for M(w) for w, = 1, € = 0.707, 
and various values of 7. Since the system is now of the third order, it can be 
unstable for a certain set of system parameters. However, it can be easily shown 
by use of the Routh-Hurwitz criterion that for @, = 1 and ¢ = 0.707, the system 
is stable for all positive values of T. The M(@) versus @ curves of Fig. 9-13 show 
that for small values of T, the bandwidth of the system is slightly increased but 
M,, is also increased. When T becomes large, the pole added to G(s) has the 
effect of decreasing the bandwidth but increasing M,. Therefore, we may 
conclude that, in general, the effect of adding a pole to the open-loop transfer 
function is to make the closed-loop system less stable. The unit step responses 
of Fig. 9-14 clearly show that for the larger values of T, 7 = 1 and T = 5, the 
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Fig. 9-14. Unit step responses of a third-order system with an open-loop 
transfer function G(s) == 1/[s(s + 1.414)U. -+ Ts)l. 


rise time increases with the decrease of the bandwidth, and the larger values of 
M, also correspond to greater peak overshoots in the step responses. However, 
it is important to point out that the correlation between M, and the peak over- 
shoot is meaningful only when the closed-loop system is stable. When the 
magnitude of G( jw) equals unity, M(q) is infinite, but if the closed-loop system 
is unstable with | G(j@)| > 1 at /GUj@a) = 180°, M(@) is finite and can assume an 
arbitrarily small number. 

The objective of these last two sections is to demonstrate the simple rela- 
tionships between the bandwidth and M,, and the characteristics of the time- 
domain response. The effects of adding a pole and a zero to the open-loop 
transfer function are discussed. However, no attempt is made to include all 
general cases. 


9.6 Relative Stability—Gain Margin, Phase Margin, and M, 


We have demonstrated in the last three sections the general relationship between 
the resonance peak M, of the frequency response and the peak overshoot of 
the step response. Comparisons and correlations between frequency-domain 
and time-domain parameters such as these are useful in the prediction of the 
performance of a feedback control system. In general, we are interested not 
only in systems that are stable, but also in systems that have a certain degree of 
stability. The latter is often termed relative stability. In many situations we may 
use M, to indicate the relative stability of a feedback control system. Another 
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way of measuring relative stability of a closed-loop system is by means of the 
Nyquist plot of the loop transfer function, G(s)H(s). The closeness of the 
G(j@)H( ja) plot in the polar coordinates to the (—1, j0) point gives an indica- 
tion of how stable or unstable the closed-loop system is. 

To demonstrate the concept of relative stability, the Nyquist plots and the 
corresponding step responses and frequency responses of a typical third-order 


G(Giw)H(jw)-plane jim GH 


t 
c(t) Mw) 
] 
0 tf oO w 
(2) 
— 270° 
(a) Stable and well-damped system. 
G(jw)A(jw)-plane jImGH 
c(t) Mw) 
1 
O ReGH 
0 t 0 w 
o(w) 
— 270° 


(b) Stable but oscillatory system. 


Fig. 9-15. Correlation among Nyquist plots, step responses, and fre- 
quency responses. 
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(c) Marginally unstable system. 
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(d) Unstable system. 


Fig. 9-15 (Cont.). Correlation among Nyquist plots, step responses, and 
frequency responses. 


system are shown in Fig. 9-15 for four different values of loop gain K. Let us 
consider the case shown in Fig. 9-15(a), in which the loop gain K is low, so the 
Nyquist plot of G(s)H(s) intersects the negative real axis at a point (the phase- 
crossover point) quite far away from the (— 1, j0) point. The corresponding step 
response is shown to be quite well behaved, and M, is low. As K is increased, 
Fig. 9-15(b) shows that the phase-crossover point is moved closer to the (— 1, j0) 
point; the system is still stable, but the step response has a higher peak over- 
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shoot, and M, is larger. The phase curve for ¢,, does not give as good an indica- 
tion of relative stability as M,, except that one should note the slope of the ¢,, 
curve which gets steeper as the relative stability decreases. The Nyquist plot of 
Fig. 9-15(c) intersects the (—1, j0) point, and the system is unstable with con- 
stant-amplitude oscillation, as shown by the step response; 7, becomes infinite. 
If K is increased still further, the Nyquist plot will enclose the (—1, j0) point, 
and the system is unstable with unbounded response, as shown in Fig. 9-15(d). 
In this case the magnitude curve M(qw) ceases to have any significance, and the 
only symptom of instability from the closed-loop frequency response is that the 
phase curve now has a positive slope at the resonant frequency. 


Gain Margin 


To give a quantitative way of measuring the relative distance between the 
G(s)H(s) plot and the (—1, j0) point, we define a quantity that is called the 
gain margin. 

Specifically, the gain margin is a measure of the closeness of the phase- 
crossover point to the (—]J, j0) point in the G(s)H(s)-plane. With reference to 
Fig. 9-16, the phase-crossover frequency is denoted by @,, and the magnitude of 
G( jo) H(ja) at m = a, is designated by | G(ja,)H(ja,)|. Then, the gain margin 


Jim GH 


G(jw)H(jw) -plane 


Phase crossover 


Fig. 9-16. Definition of the gain margin in the polar coordinates. 
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of the closed-loop system that has G(s)H(s) as its loop transfer function is 
defined as 


gain margin = G.M. = 20 log; : dB (9-39) 
|GVa. 


1 
JH.) | 

On the basis of this definition, it is noticed that in the G(j@)H(ja) plot of 
Fig. 9-16, if the loop gain is increased to the extent that the plot passes through 
the (—1, j0) point, so that] G(jw,)H(j@,) | equals unity, the gain margin becomes 
0 dB. On the other hand, if the G(jw)H(jw) plot of a given system does not 
intersect the negative real axis, | G(j@,)H(jw,)| equals zero, and the gain margin 
defined by Eq. (9-39) is infinite in decibels. Based on the above evaluation, the 
physical significance of gain margin can be stated as follows: Gain margin is 
the amount of gain in decibels that can be allowed to increase in the loop before 
the closed-loop system reaches instability. 

When the G(jw)H(ja) plot goes through the (— 1, j0) point, the gain margin 
is 0 dB, which implies that the loop gain can no longer be increased as the 
system is already on the margin of instability. When the G(j@)H(ja) plot does 
not intersect the negative real axis at any finite nonzero frequency, and the 
Nyquist stability criterion indicates that the (—1, j0) point must not be enclosed 
for system stability, the gain margin is infinite in decibels; this means that, 
theoretically, the value of the loop gain can be increased to infinity before 
instability occurs. 

When the (—1, j0) point is to the right of the phase-crossover point, the 
magnitude of G(jo,)H(ja,) is greater than unity, and the gain margin as given 
by Eq. (9-39) in decibels is negative. In the general case, when the above men- 
tioned condition implies an unstable system, the gain margin is negative in 
decibels. It was pointed out in Chapter 7 that if G(s)H(s) has poles or zeros in 
the right half of the s-plane, the (—1, /0) point may have to be encircled by the 
G(j@)H(j@) plot in order for the closed-loop system to be stable. Under this 
condition, a stable system yields a negative gain margin. In practice, we must 
first determine the stability of the system (i.e., stable or unstable), and then the 
magnitude of the gain margin is evaluated. Once the stability or instability 
condition is ascertained, the magnitude of the gain margin simply denotes the 
margin of stability or instability, and the sign of the gain margin becomes 
insignificant. 


Phase Margin 


The gain margin is merely one of many ways of representing the relative 
stability of a feedback control system. In principle, a system with a large gain 
margin should be relatively more stable than one that has a smaller gain margin. 
Unfortunately, gain margin alone does not sufficiently indicate the relative 
stability of all systems, especially if parameters other than the loop gain are 
variable. For instance, the two systems represented by the G(jw)H(ja) plots of 
Fig. 9-17 apparently have the same gain margin. However, locus A actually 
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Fig. 9-17, Nyquist plots showing systems with same gain margin but dif- 
ferent amount of relative stability. 


corresponds to a more stable system than locus B. The reason is that with any 
change in a system parameter (or parameters) other than the loop gain, it is 
easier for locus B to pass through or even enclose the (—-1, j0) point. Fur- 
thermore, system B has a much larger M, than system A. 

In order to strengthen the representation of relative stability of a feedback 
control system, we define the phase margin as a supplement to gain margin. 
Phase margin is defined as the angle in degrees through which the G(jw)H(jw) 
plot must be rotated about the origin in order that the gain-crossover point on the 
locus passes through the (—1, j0) point. Figure 9-18 shows the phase margin as 
the angle between the phasor that passes through the gain-crossover point and 
the negative real axis of the G( j@)H(jw)-plane. In contrast to the gain margin, 
which gives a measure of the effect of the loop gain on the stability of the closed- 
loop system, the phase margin indicates the effect on stability due to changes of 
system parameters, which theoretically alter the phase of G(j@)H( jw) only. 

The analytical procedure of computing the phase margin involves first 
the calculation of the phase of G( j@)H(ja) at the gain-crossover frequency, and 
then subtracting 180° from this phase; that is, 


phase margin = $.M. = /G(j@,)H(jw,) — 180° (9-40) 


where qw, denotes the gain-crossover frequency. If the (— 1, j0) point is encircled 


Sec. 9.6 Relative Stability—Gain Margin, Phase Margin, and M, / 479 


jim GH 


GUw)H(jw)-plane 


Re GH 


Phase 
margin 


Gain crossover 
W=w 


& 


Fig. 9-18. Phase margin defined in the G(jw)H (jw)-plane. 


by the G(jw)H (ja) plot, the gain-crossover point would be found in the second 
quadrant of the G(jw)H(ja)-plane, and Eq. (9-40) would give a negative phase 
margin. 


Graphic Methods of Determining Gain Margin and Phase Margin 


Although the formulas for the gain margin and the phase margin are 
simple to understand, in practice it is more convenient to evaluate these quan- 
tities graphically from the Bode plot or the magnitude-versus-phase plot. As an 
illustrative example, consider that the open-loop transfer function of a control 
system with unity feedback is given by 


10 
s(l + 0.02s)(1 + 0.25) 


The Bode plot of G( ja) is shown in Fig. 9-19. Using the asymptotic approxima- 
tion of |G(ja)|, the gain-crossover and the phase-crossover points are deter- 
mined as shown in the figure. The phase-crossover frequency is approximately 
16 rad/sec, and the magnitude of G(j@) at this frequency is about —15 dB. This 
means that if the loop gain of the system is increased by 15 dB, the magnitude 
curve will cross the 0-dB axis at the phase-crossover frequency. This condition 


G(s) = (9-41) 
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Fig. 9-19. Bode plot of G(s) = 10/[s(1 + 0.2s)(1 + 0.025)]. 


corresponds to the Nyquist plot of G(j@) passing through the (—1, j0) point, 
and the system becomes marginally unstable. Therefore, from the definition of 
the gain margin, the gain margin of the system is 15 dB. 

To determine the phase margin, we note that the gain-crossover frequency 
is at @ = 7 rad/sec. The phase of G(jq@) at this frequency is approximately 
—125°. The phase margin is the angle the phase curve must be shifted so that it 
will pass through the — 180° axis at the gain-crossover frequency. In this case, 


¢@.M. = 180° — 125° = 55° (9-42) 

In general, the procedure of determining the gain margin and the phase 
margin from the Bode plot may be outlined as follows: 

1. The gain margin is measured at the phase-crossover frequency @,: 

G.M. = —|G(jo,)H(ja.)| dB (9-43) 
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Fig. 9-20. Magnitude-versus-phase plot of G(s) = 10/[s(1 + 0.2s)Q1 + 
0.02s)). 


2. The phase margin is measured at the gain-crossover frequency @, : 
$-M. = 180° + /G(ja,)H(ja,) (9-44) 


The gain and phase margins are even better illustrated on the magnitude- 
versus-phase plot. For the transfer function of Eq. (9-41), the magnitude- 
versus-phase plot is shown in Fig. 9-20, which is constructed by use of the data 
from the Bode plot of Fig. 9-19. On the magnitude-versus-phase plot of G( ja), 
the phase crossover point is where the locus intersects the —180° axis, and the 
gain crossover is where the locus intersects the 0-dB axis. Therefore, the gain 
margin is simply the distance in decibels measured from the phase crossover to 
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Fig. 9-21 (Cont.). Polar plot, Bode diagram, and magnitude-versus-phase 
plot, showing gain and phase margins in these domains. 


the critical point at 0dB and —180°, and the phase margin is the horizontal 
distance in degrees measured from the gain crossover to the critical point. 

In summarizing, the relations between the measurements of the gain margin 
and the phase margin in the polar plot, the Bode plot, and the magnitude- 
versus-phase plot are illustrated in Fig. 9-21. 


9.7 Relative Stability As Related to the Slope of the Magnitude 
Curve of the Bode Plot 


In general, a definite relation between the relative stability of a closed-loop 
system and the slope of the magnitude curve of the Bode plot of G( ja@)H(ja) at 
the gain crossover can be established. For example, in Fig. 9-19, if the loop gain 
of the system is decreased from the nominal value, the gain crossover may be 
moved to the region in which the slope of the magnitude curve is only —20 
dB/decade; the corresponding phase margin of the system would be increased. 
On the other hand, if the loop gain is increased, the relative stability of the sys- 
tem will deteriorate, and if the gain is increased to the extent that the gain 
crossover occurs in the region where the slope of the magnitude curve is —60 
dB/decade, the system will definitely be unstable. The example cited above is a 
simple one, since the slope of the magnitude curve decreases monotonically as 
c@ increases. Let us consider a conditionally stable system for the purpose of 
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Fig, 9-22. Bode plot of G(s) = [K(1 + 0.25)(1 + 0.025s)}/[s3(1 + 0.015) 
(L + 0.005s)]. 


illustrating relative stability. Consider that a control system with unity feedback 
has the open-loop transfer function 


K(_+ 0.25)(1_+ 0.0255) (9-45) 
x31 + 0.01s)(1 -F 0.0055) 


The Bode plot of G(s) is shown in Fig. 9-22 for K = |. The gain-crossover 
frequency is 1 rad/sec, and the phase margin is negative. The closed-loop system 
is unstable even for a very small value of K. There are two phase crossover 
points: one at w = 15 rad/sec and the other at m = 12C rad/sec. The phase 
characteristics between these two frequencies indicate that if the gain crossover 
lies in this range, the system is stable. From the magnitucle curve of the Bode 
plot, the range of K for stable operation is found to be between 60 and 90 dB. 
For values of K above and below this range, the phase lag of G(ja@) exceeds 
— 180° and the system is unstable. This system serves as a good example of the 
relation between relative stability and the slope of the magnitude curve at the 
gain crossover. As observed from Fig. 9-22, at both very low and very high 


G(s) = 
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frequencies, the slope of the magnitude curve is —60 dB/decade; if the gain 
crossover falls in either one of these two regions, the phase margin becomes 
negative and the system is unstable. In the two sections of the magnitude curve 
that have a slope of —40 dB/decade, the system is stable only if the gain cross- 
over falls in about half of these regions, but even then the resultant phase margin 
is small. However, if the gain crossover falls in the region in which the magnitude 
curve has a slope of —20 dB/decade, the system is stable. 

The correlation between the slope of the magnitude curve of the Bode plot 
at the gain crossover and the relative stability can be used in a qualitative way 
for design purposes. 


9.8 Constant M Loci in the G(/@)-Plane 


In previous sections it was shown that the resonance peak M, of the closed-loop 
frequency response is directly related to the maximum overshoot of the transient 
response. Normally, the magnification curve of M(q@) versus @ may be con- 
structed by the Bode plot method if the closed-loop transfer function M(s) is 
given and if its numerator and denominator are in factored form. Unfortunately, 
this is not the usual case, as the open-loop transfer function G(s) is normally 
given. For the purpose of analysis we can always obtain the magnification curve 
by digital computation on a computer. However, our motivation is to be able 
to predict M, from the plots of G( ja), and eventually to design a system with a 
specified M,. 

Consider that the closed-loop transfer function of a feedback control 
system with unity feedback is given by 


C(s)_ G(s) 


M(s) = Rs) ~ 1+ GO) (9-46) 
For sinusoidal steady state, G(s) = G(ja) is written 
G(ja) = Re G(j j Im G(j 
(jo) = Re Cia) + jIm G(jo) (9-47) 
= ee JY 
Then 
= | — | Glia) 
M(w) = | M(jo)| =| PY 
(9-48) 


i OEY 
SL + x)? + y? 
For simplicity, let M = M(@); then Eq. (9-48) leads to 
MSL + x)? + y? = /x? + y? (9-49) 
Squaring both sides of the last equation gives 


M1 + x)? + yp] =x? + y? (9-50) 
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Rearranging this equation yields 
(1 — M?)x? + (1 — M2)y? — 2M?x = M? (9-51) 


This equation is conditioned by dividing through by (1 — M?*) and adding the 
term [M?/(1 — M?)}? on both sides. We have 


2M2 M2 2 M2 M2 2 
e+ Sop + (oop) =a top) os 


which is finally simplified to 
M2 2 M 2 
(x —7Sqn) += (; nn) (9-53) 


For a given M, Eq. (9-53) represents a circle with the center at x = 
M?/(1 — M*), y= 0. The radius of the circle is r = | M/(. — M?)|. Equation 
(9-53) is invalid for M = 1. For M = 1, Eq. (9-50) gives 

1 
BS ay (9-54) 
which is the equation of a straight line parallel to the j Im G( jo) axis and passing 
through the (—4, j0) point in the G(jq)-plane. 

When M takes on different values, Eq. (9-53) describes in the G(ja)-plane 
a family of circles that are called the constant M loci or the constant M circles. 
The coordinates of the centers and the radii of the constant M loci for various 
values of .M are given in Table 9-1, and some of the loci are shown in Fig. 9-23. 


Table 9-1. Constant M Circles 
ee, 


M Center x = i Mn y=0 Radius r = Fee 
se 
0.3 0.01 0.33 
0.5 0.33 0.67 
0.7 0.96 1.37 
1.0 for) s 
1.1 —5.76 5.24 
1.2 —3.27 2.73 
1.3 —2.45 1.88 
1.4 —2.04 1.46 
1.5 —1.80 1.20 
1.6 —1.64 1.03 
1.7 —1.53 0.90 
1.8 —1.46 0.80 
1.9 —1.38 0.73 
2.0 —1.33 0.67 
2.5 —1.19 0.48 
3.0 —1.13 0.38 
4.0 —1.07 0.27 
5.0 —1.04 0.21 
6.0 —1.03 0.17 


a 
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Fig. 9-23. Constant M circles in the polar coordinates. 


Note that when M becomes infinite, the circle degenerates into a point at the 
critical point, (—1, j0). This agrees with the well-known fact that when the 
Nyquist plot of G( jw) passes through the (—1, j0) point, the system is marginally 
unstable and M, is infinite. Figure 9-23 shows that the constant M loci in the 
G(ja)-plane are symmetrical with respect to the M = 1 line and the real axis. 
The circles to the left of the M = 1 locus correspond to values of M greater than 
1, and those to the right of the M = 1 line are for M less than I. 

Graphically, the intersections of the G( ja) plot and the constant M loci give 
the value of M at the frequency denoted on the G(jq@) curve. If it is desired to 
keep the value of M, less than a certain value, the G( ja) curve must not intersect 
the corresponding M circle at any point, and at the same time must not enclose 
the (—1, j0) point. The constant M circle with the smallest radius that is tangent 
to the G( jw) curve gives the value of M,, and the resonant frequency @, is read 
off at the tangent point on the G( ja) curve. 

Figure 9-24(a) illustrates the Nyquist plot of G( jm) for a unity feedback 
control system, together with several constant M loci. For a given loop gain 
K = K,, the intersects between the G(ja) curve and the constant M loci give 
the points on the M(q)-versus-a@ curve. The peak resonance M, is found by 
locating the smallest circle that is tangent to the G(jq@) plot. The resonant fre- 
quency is found at the point of tangency and is designated as w,,. If the loop 
gain is increased to K,, and if the system is still stable, a constant M circle with 
a smaller radius that corresponds to a larger M is found tangent to the G( ja) 
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Fig. 9-24. Polar plots of G(s) and constant M loci showing the procedure 
of determining M, and the magnification curves. 


curve, and thus the peak resonance M p is larger. The resonant frequency is 
shown to be @,2, which is closer to the phase-crossover frequency q@, than @,;. 
When K is increased to K; so that the G( j@) curve passes through the (—1, j0) 
point, the system is marginally unstable, M » is infinite, and w,, = @,. In all 
cases the bandwidth of the closed-loop system is found at the intersect of the 
G( ja) curve and the M = 0.707 locus. For values of K beyond K;, the system is 
unstable, and the magnification curve and M, no longer have any meaning. 
When enough points of intersections between the G(ja) curve and the constant 
M loci are obtained, the magnification curves are plotted as shown in Fig. 
9-24(b). 
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9.9 Constant Phase Loci in the G(/@)-Plane 


The loci of constant phase of the closed-loop system may also be determined in 
the G(j@)-plane by a method similar to that used to secure the constant M loci. 
With reference to Eqs. (9-46) and (9-47), the phase of the closed-loop system 
is written as 


= i — v1 ne fa “1 ae = 
bn(o) = [MUo) = tan-'(2) — tan (; 2 z) (9-55) 
Taking the tangent on both sides of the last equation and letting $,, = ¢n(), 
we have 
= y 7 
Sa re aang (9-56) 
Let N = tan @,,; then Eq. (9-56) becomes 
e+xty——=0 (9-57) 
Adding the term (1/4) + (J/4N7) to both sides of Eq. (9-57) yields 


eteptsy-~2tga= (9-58) 


which is regrouped to give 
1\? 1\? 1 I 
(x +3) + (» - ay) = 4 + aN? e)) 


When WN assumes various values, this equation represents a family of circles 
with centers at (x, y) = (—1/2, 1/2N). The radii are given by 


r= (4ety” (9-60) 


The centers and the radii of the constant N circles for various values of N 
are tabulated in Table 9-2, and the loci are shown in Fig. 9-25. 


Table 9-2. Constant N Circles 


ies N= tan bm Center x =—4,y = aK Radius r = 4/N7I 
90 —co 0 0.500 
—60 —1,732 —0.289 0.577 
—45 — 1.000 —0.500 0.707 
—30 —0.577 —0.866 1.000 
-15 —0.268 — 1,866 1.931 
0 0 (2) fo) 
15 0.268 1.866 1,931 
30 0.577 0.866 1,000 
45 1,000 0.500 0.707 
60 1.732 0.289 0.577 


90 eo 0 0.500 
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Fig. 9-25. Constant N circles in the polar coordinates. 


9.10 Constant M and WN Loci in the Magnitude-Versus-Phase 
Plane—The Nichols Chart 


In principle we need both the magnitude and the phase of the closed-loop 
frequency response to analyze the performance of the system. However, we have 
shown that the magnitude curve, which includes such information as M,, w, 
and BW, normally is more useful for relative stability studies. 

A major disadvantage in working with the polar coordinates for the G( ja) 
plot is that the curve no longer retains its original shape when a simple modifica- 
tion such as the change of the loop gain is made to the system. In design prob- 
lems, frequently not only the loop gain must be altered, but series or feedback 
controllers are to be added to the original system which require the complete 
reconstruction of the resulting G( jw). For design purposes it is far more con- 
venient to work in the Bode diagram or the magnitude-versus-phase domain. 
In the Bode diagram the magnitude curve is shifted up and down without dis- 
tortion when the loop gain is varied; in the magnitude-versus-phase plot, the 
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Fig. 9-26. (a) Constant M circles in the G(jq@)-plane. (b) Nichols chart in 
the magnitude-versus-phase coordinates. 


entire G( ja) curve is shifted up or down vertically when the gain is altered. In 
addition, the Bode plot can be easily modified to accommodate any modifica- 
tions made to G(jq@) in the form of added poles and zeros. 

The constant M and constant N loci in the polar coordinates may be 
transferred to the magnitude-versus-phase coordinates without difficulty. 
Figure 9-26 illustrates how this is done. Given a point on a constant M circle 
in the G(jq@)-plane, the corresponding point in the magnitude-versus-phase 
plane may be determined by drawing a vector directly from the origin of the 


Gain (decibels) 


a2: 
LALLY 
Ss BS 


Phase 


Fig. 9-27. Nichols chart (for phase from —180° to 0°), 


G(ja)-plane to the particular point on the constant M circle; the length of the 
vector in decibels and the phase angle in degrees give the corresponding point 
in the magnitude-versus-phase plane. Figure 9-26 illustrates the process of locat- 
ing three arbitrary corresponding points on the constant M loci in the magni- 
tude-versus-phase plane. The critical point, (—1, j0), in the G( j@)-plane corre- 
sponds to the point with 0 dB and — 180° in the magnitude-versus-phase plane. 
492 


dB 


Fig. 9-28. Nichols chart (for phase from —270° to —90°). 


Using the same procedure as described above, the constant N loci are also 
transferred into the magnitude-versus-phase plane. These constant M and N 
loci in the magnitude-versus-phase coordinates were originated by Nichols? and 
called the Nichols chart. A typical Nichols chart is constructed in Fig. 9-27 for 
the phase angle that extends from —180° to 0°. The chart that corresponds to 
the phase from —360° to —180° is a mirror image of that in Fig. 9-27 with 

493 
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respect to the —180° axis. In Fig. 9-28 the Nichols chart is shown for —90° to 
—270°, which is the useful region of phase for many practical control systems. 
The values of M on these constant M loci are given in decibels. To determine 
bandwidth, the —3-dB locus should be used. 

The following example will illustrate the relationships among the analysis 
methods using the Bode plot, the magnitude-versus-phase plot, and the Nichols 
chart. 


EXAMPLE 9-1 _ Let us consider the positional control system discussed in Section 6.6. 
When the inductance of the de motor is 0.1 H, the open-loop transfer 
function of the system is given by Eq. (6-149) and is repeated here: 


250A 
s(s?_ +- 50.55 +- 1725) 


The Bode plot for G(s) is drawn as shown in Fig. 9-29 for .4 = 200. The gain 


G(s) = (9-61) 


4 Gain margin 
L=0.01 | 


IGw)I(L = 0.01) 
a ae 


“ 


~ 


10 37.3 100 463 1000 w rad/sec 


Phase margin P 
L=0.01 [Gliw) 


Phase margin a 1 
L=0.1 <i Le 0.01) 
10 41.5 100 463 1000 
w rad/sec 


Fig. 9-29. Bode plots of the system in Example 9-1. 


margin and the phase margin are determined from the Bode plot to be 5 dB and 40°, 
respectively. The data on the magnitude and phase of G(j@) are transferred to the 
magnitude-versus-phase plot of Fig. 9-30. From Fig. 9-30, the peak resonance M, pis 
found to be approximately 5 dB (or 1.78), the resonant frequency is 40 rad/sec, the 
bandwidth of the system is 48 rad/sec, and the results for the gain and phase margins 
are as given above. 

When the motor inductance is reduced to 0.01 henry, the open-loop transfer 
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M=5 dB (1.78) 


Hc GUjw) (L = 0.1) AL G(jw)(L = 0.01) 


65 rad/sec | 90 
I. 
/ 
H 


| 150 rad/sec 


~ 200 — 180 — 160 ~ 140 — 120 — 100 — 90 
Phase (degrees) 
Fig. 9-30. Magnitude-versus-phase plots for the system in Example 9-1. 


, 


function of the system becomes 
G(s) = 2500A 


5s? + 5005 + 17270) (762) 


With A = 200, and for the purpose of constructing the Bode plot, G(s) is written | 


29 


OAS) = SF O.002T6s)T + 0.02685) 


(9-63) 
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The Bode plot of G(s) is shown in Fig. 9-29. It is shown that by decreasing the 
inductance, the gain margin is improved to approximately 24 dB, and the phase margin 
is about 50°. The magnitude-versus-phase plot in Fig. 9-30 indicates that the bandwidth 
of the system is not noticeably changed, but M, is reduced to approximately 1.4 dB, 
or 1.18. The frequency-domain results obtained in this example for the two values of 
inductance correlate quite well with the time-domain analysis that resulted in the time 
responses of Fig. 6-21. Table 9-3 gives a comparison of the time-domain and frequency- 
domain parameters. 


Table 9-3 Comparison of the Time-Domain and Frequency-Domain Performances 
of the System in Example 9-1 


Peak Rise Delay Gain Phase 
L Overshoot Time Time BW Margin Margin 
(henrys) (%) {sec) (sec) (radj/sec) My @p (dB) (deg) 
0.1 41 0.4 0.5 48 1.78 40 5 49 
0.01 11.5 0.6 0.4 50 1.18 35 24 50 


9.11 Closed-Loop Frequency Response Analysis of Nonunity 
Feedback Systems 


The constant M and N loci and the Nichols chart analysis discussed in preceding 
sections are limited to closed-loop systems with unity feedback, whose transfer 
function is given by Eq. (9-46). When a system has nonunity feedback, the closed- 
loop transfer function is 


C(s) _ G(s) 
R(s) 1 + G(s)H(s) 


the constant M and AN loci derived earlier and the Nichols charts of Figs. 9-27 

and 9-28 cannot be applied directly. However, we can show that with a slight 

modification these loci can still be applied to systems with nonunity feedback. 
Let us consider the function 


M(s) = 


(9-64) 


_ _ G(s)H(s) z 
P(s) = T+ G@H@ (9-65) 
Comparing Eq. (9-64) with Eq. (9-65), we have 
P(s) = M(s)H(s) (9-66) 


Information on the gain margin and the phase margin of the system of Eq. 
(9-64) can be obtained in the usual fashion by constructing the Bode plot of 
G(s)A(s). However, the G( ja) H( ja) curve and the Nichols chart together do not 
give the magnitude and phase plots for M(j@), but for P( ja). Since M(j@) and 
P(jq@) are related through Eq. (9-66), once the plots for P(w) versus @ and 
/P(j@) versus @ are obtained, the curves for M(q@) and ¢,,(c2) versus q@ are 
determined from the following relationships: 
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M(o) = my (9-67) 
$n(e) = | Pia) — [H(jo) (9-68) 


9.12 Sensitivity Studies in the Frequency Domain‘ 


The frequency-domain study of feedback control systems has an advantage in 
that the sensitivity of a transfer function with respect to a given parameter can 
be clearly interpreted. We shall show how the Nyquist plot and the Nichols 
chart can be utilized for analysis and design of a control system based on sensi- 
tivity considerations. 

Consider that a control system with unity feedback has the transfer function 


Cs) G(s) 2 
MG) = RG) = T+ 6) Ge?) 


The sensitivity of M(s) with respect to G(s) is defined as 


my.) _ 4M(s)/M(s) . 
S#(s) = “dG(s/G(s) (9-70) 
or 
u;.\ _. 4M(s) G(s) 2 
Substituting Eq. (9-69) into Eq. (9-71) and simplifying, we have 
Mi.) — | 
S#(s) = T+ G@) (9-72) 


Clearly, the sensitivity function is a function of the complex variable s. 

In general, it is desirable to keep the sensitivity to a small magnitude. From 
a design standpoint, it is possible to formulate a design criterion in the following 
form: 


| So Ol=TTEee 4. Gas" (9-73) 


In the sinusoidal steady state, Eq. (9-73) is easily interpreted in the polar 
coordinate by a Nyquist plot. Equation (9-73) is written 


| 1 + G(ja)| => : (9-74) 


Figure 9-31 illustrates the Nyquist plot of a stable closed-loop system. 
The constraint on sensitivity given in Eq. (9-74) is interpreted as the condition 
that the G( ja) locus must not enter the circle with radius k. It is interesting to 
note that the sensitivity criterion is somewhat similar to the relative stability 
specifications of gain and phase margins. When the value of k is unity, the 
G(jq@) locus must be tangent or outside the circle with a unity radius and centered 
at the (—1, j0) point. This corresponds to a very stringent stability requirement, 
since the gain margin is infinite. On the other hand, if the Nyquist plot of G(ja) 
passes through the (—1, j0) point, the system is unstable, and the sensitivity is 
infinite. 
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Fig. 9-31. Interpretation of sensitivity criterion with the Nyquist plot. 


Equation (9-74) and Fig. 9-31 also indicate clearly that for low sensitivity, 
the magnitude of G(ja) should be high, which reduces the stability margin. 
This again points to the need of compromise among the criteria in designing 
control systems. 

Although Fig. 9-31 gives a clear interpretation of the sensitivity function 
in the frequency domain, in general, the Nyquist plot is awkward to use for 
design purposes. In this case the Nichols chart is again more convenient for 
the purpose of analysis and design of a feedback control system with a prescribed 
sensitivity. Equation (9-72) is written 

ah 
S¥(jo) = ree5 (9-75) 
which clearly indicates that the magnitude and phase of S2( jw) can be obtained 
by plotting G~'(j@) in the Nichols chart and making use of the constant M loci 
for constant sensitivity function. Since the vertical coordinate of the Nichols 
chart is in decibels, the G~1(jq@) curve in the magnitude-versus-phase coordinates 
can be easily obtained if the G(jq) is already available, since 


|G~"(jo)| dB = —|G(ja)| dB (9-76) 

[G""(jo) = —/Gja) (9-77) 

As an illustrative example, the function G~'(jw) for Eq. (9-61), Example 
9-1, is plotted in the Nichols chart as shown in Fig. 9-32, using the G( ja) plot 


in Fig. 9-30. The intersects of the G-'(j@) curve in the Nichols chart with the 
constant M loci give the magnitudes of S¥( jw) at the corresponding frequencies. 
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Fig. 9-32. Determination of the sensitivity function S2 in the Nichols chart. 


Figure 9-32 indicates several interesting points with regard to the sensitivity 
function of the feedback control system. The sensitivity function S3’ approaches 
0 dB or unity as @ approaches infinity. Sf becomes zero as w approaches zero. 
A peak value of 8 dB is reached by S2% at wm = 42 rad/sec. This means that 
the closed-loop transfer function is most sensitive to the change of G(jq) at this 
frequency and more generally in this frequency range. This result is not difficult 
to comprehend, since from the Nichols chart of Fig. 9-30 it is observed that 
the stability and dynamic behavior of the closed-loop system is more directly 
governed by the G(j@) curve near w,, which is 40 rad/sec. Changes made to 
portions of G(jq@) at frequencies much higher and much lower than 40 rad/sec 
are not going to have a great effect on the relative stability of the system directly. 
When the loop gain of the system increases, the G(jq@) curve is raised in the 
Nichols chart domain, and the G~'(jq@) curve must be lowered. If the G(j@) curve 
passes through the critical point at 0 dB and — 180°, the system becomes mar- 
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ginally unstable; the G-1(jq@) also passes through the same point, and the sensi- 
tivity is infinite. 

In this section we have simply demonstrated the use of the Nichols chart 
for the analysis of the sensitivity function of a closed-loop system. In a design 
problem, the objective may be to find a controller such that the sensitivity due 
to certain system parameters is small. 
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PROBLEMS 


9.1. The pole-zero configuration of a closed-loop transfer function is shown in 
Fig. P9-1(a). 
(a) Compute the bandwidth of the system. 
(b) A zero is added to the closed-loop system, as shown in Fig. P9-1(b); how 
is the bandwidth affected ? 


(a) (b) 
Figure P9-1. 


eee 
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(c) Another pole is inserted on the negative real axis in Fig. P9-1(b), but at a 
distance 10 times farther from the origin than the zero; how is the band- 
width affected ? 


9,2. The specification given on a certain second-order feedback control system is 
that the overshoot of the step response should not exceed 25 per cent. 
(a) What are the corresponding limiting values of the damping ratio and peak 
resonance M,? 
(b) Determine the corresponding values for @, and tmax- 


9.3. Sketch the closed-loop frequency response | M(j@)| as a function of frequency 
for the systems and responses shown in Fig. P9-3. 


(c) 


(d) 


Figure P9-3. 
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(e) Sketch the unit step response for the system whose | M |-versus-@ curve is as 
shown. Assume that the system is of second order. 


\M| 1.5 
i 
0.8 
| 
i 
{ 
0 2 @ 
rad/sec 
(e) 
Figure P9-3 (Cont.). 


9.4. The closed-loop transfer function of a feedback control system is given by 


= Els) _ = Pee ee 

~ Rs) A + 0.015) + 0.055 + 0.0152) 

(a) Plot the frequency response curve for the closed-loop system. 

(b) Determine the peak resonance peak M, and the resonant frequency @, of 
the system. 

(c) Determine the damping ratio ¢ and the natural undamped frequency a, of 
the second-order system that will produce the same 7, and w, determined 
for the original system. 


Mos) 


9.5. The open-loop transfer function of a unity feedback control system is 


ape eos 
sl + 0.15) + 5) 
(a) Determine the value of K so that the resonance peak M, of the system is 
equal to 1.4. 
(b) Determine the value of K so that the gain margin of the system is 20 dB. 
(c) Determine the value of K so that the phase margin of the system is 60°. 
9.6. The open-loop transfer function of a unity feedback control system is 


K( + Ts) 
si + s)(1 + 0.015) 
Determine the smallest possible value of T so that the system has an infinite 
gain margin. 
9.7. The open-loop transfer function of a unity feedback control system is 


K 
s(1 + 0.1s)(1 + 0.0015) 


Determine the value of K if the steady-state error of the output position must 
be less than or equal to 0.1 per cent for a ramp function input. With this value of 
K, what are the gain margin and the phase margin of the system? Plot G(s) in 
the gain-phase plot and determine the resonance peak M, and the resonant 
frequency @,. 


G(s) = 


G(s) = 


G(s) = 


9.8. A random compensation network is added to the forward path of the system 
in Problem 9.7, so that now the open-loop transfer function reads 
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G(s) = K(i + 0.0167s) 

~ s(1 + 0,00222s)(1 + 0.15)(1 + 0.0015) 
where K is determined in part (a) of Problem 9.7. Plot the gain-phase diagram 
of G(s). Evaluate M,, @,, the gain margin, the phase margin, and the band- 
width of the compensated system. 


9.9. The Bode diagram of the open-loop transfer function G(s) of a unity feedback 
control system is shown in Fig. P9-9. 


w(rad/sec ) 
mee 1 10 100 103 104 
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Figure P9-9. 


(a) Find the gain margin and the phase margin of the system. 

(b) If the open-loop transfer function is changed to e~7*G(s), find the value of T 
so that the phase margin of the system is 45°. Then find the value of T so 
that the gain margin is 20 dB. 

(c) What is the velocity error constant of the system in part (a)? in part (b)? 


10. 


Introduction to Control 


Systems Design 


10.1 Introduction 


Design of control systems represents an interesting and complex subject in con- 
trol systems studies. In a simplified manner the design problem of control sys- 
tems can be described with the aid of the block diagram of Fig. 10-1. The figure 


Controlled c(t) 
process G, 


Control 
vector 


Controlled variable 
vector (output vector) 


Fig. 10-1. Block diagram of a controlled process. 


shows a controlled process whose output vector ¢(t) represents q controlled 
variables, and the control vector u(t) represents p control signals. The problem 
is to find a set of “appropriate” signals, u(t), so that the controlled variable 
vector ¢e(¢) behaves as desired. The description of the basic design problem is 
simplified by overlooking the possible existence of external disturbances. 

Once the desired control vector u(¢) for satisfactory control is determined, 
a controller is usually needed to generate this control from the reference inputs 
and the state vector x(f) or output c(t). Figure 10-2 illustrates the block diagram 
of a control system whose control vector is derived from the input vector and 
the state vector. This type of system is also referred to as one with state feed- 
back. The block diagram of Fig. 10-2 is intended only for the purpose of illus- 
trating the philosophy of designing control systems, and no attempt is made for 
it to include all possible configurations. 
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r(t) c(t) 


Controlled 
process 
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x(t) 


Fig. 10-2. Block diagram of a control system with state feedback. 


It is interesting to give a brief review on the history of development of con- 
trol system design theory, which may help gain perspective in the understanding 
of the subject. 

The early stage of the theoretical development of the design of control sys- 
tems was characterized by the works of Nyquist, Hall, Nichols,? and Bode,! 
who developed such classical methods as the Nyquist plot, Bode diagram, and 
Nichols chart. A unique feature of these methods is that they are all graphical 
techniques which are conducted in the frequency domain. As was pointed out 
earlier that in the design of control systems, it is the time response that is of 
importance, rather than the frequency response. The use of the frequency- 
domain techniques is simply due to the fact that the graphical techniques are 
convenient to apply. 

The classical design methods are characterized by first fixing the configura- 
tion of the system to be designed. In other words, the designer must first choose 
a suitable system configuration. For instance, Fig. 10-3(a) shows the block 
diagram of a system with the controller located in the forward path of the sys- 
tem. This is a very common practice because of the versatility of the scheme, and 
the system is said to have a cascade or series compensation. Figure 10-3(b) 
shows another scheme of compensation by having a controller in the feedback 
path, and this is often referred to as the feedback compensation. In general, 
other configurations, such as having controllers in both the forward path and 
the feedback path, may be used if desired. In practice, the controllers or com- 
pensators used in control systems may assume a great variety of forms. In the 
simple cases, the controller may be passive networks in the form of low-pass, 
high-pass, or band-pass filters, or networks with active elements. In elaborate 
cases, the controller may even be a mini-computer. 

The proper selection of the system configuration as well as the contents of 
the controller depend to a great extent on the experience and ingenuity on the 
part of the designer. In the frequency-domain design, the design specifications 
usually are given in terms of such criteria as gain margin, phase margin, peak 
resonance, and bandwidth. These criteria, however, should be related to the 
time-domain specifications, such as rise time, overshoot, and settling time, 
which are more direct measurements of the system’s performance. 

The classical design of control systems is very much a trial-and-error pro- 
position. This is a distinct disadvantage of the method, since it does not indicate 
whether a solution even actually exists for the design problem at the outset. It 
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Fig. 10-3. Block diagrams of control systems with two different schemes 
of compensation. (a) Series compensation. (b) Feedback compensation. 


is entirely possible that the design requirements are so stringent or may even be 
contradictory so that they cannot be satisfied by any system configuration or 
controllers that are physically realizable. Even when a solution does exist, the 
classical design yields a system that is very seldom the best by any standards. 
For instance, gain margin and phase margin are measures of the relative stability 
of a control system. A system having a gain margin of, say, 20 dB or a phase 
margin of 45° does not imply that it is optimal in any sense. 

The introduction of the root locus technique by Evans‘ in 1950 made pos- 
sible the design of control systems to be carried out in the s-plane. The main 
advantage of the root locus method is that information on frequency-domain as 
well as time-domain characteristics can be derived directly from the pole-zero 
configuration in the s-plane. With the knowledge of the closed-loop transfer 
function poles and zeros, the time-domain response is determined readily by 
means of inverse Laplace transform, and the frequency response is obtained 
from the Bode plot. However, the root locus design is still basically a trial-and- 
error procedure, and it relies on the reshaping of the root loci to obtain a satis- 
factory pole-zero configuration for the closed-loop transfer function. 

The work by Norbert Wiener? in the late 1940s opened a new horizon to 
the design of control systems. Wiener introduced not only the statistical con- 
siderations of control systems but also the idea of the performance index. For 
the first time, the design engineer was able to start from a set of design criteria 
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and carry out the design by means of a completely analytical procedure. He is 
able to design a control system that is optimum or the best possible with respect 
to a given performance criterion. 

In many practical applications of control systems, the actual signals and 
disturbances subjected by a control system may be random in nature. Unlike 
the deterministic signals, such as the step function and the sinusoidal function 
considered in the preceding chapters, random signals can be adequately described 
only by their statistical properties. For instance, in the problem of controlling 
the antenna of a radar system, the wind force acting on the antenna is best 
described by some probabilistic function rather than by a sine wave or any other 
deterministic signals. The main difference between a deterministic signal and 
a random signal is that the magnitude of the latter can only be described as what 
is the probability that it will lie in a certain range at a given time. 

The principle of Wiener’s optimization technique is demonstrated by the 
block diagram shown in Fig. 10-4. The design objective is to determine the 
closed-loop transfer function C(s)/R(s) of the system such that the error between 
the desired output and the actual output is minimized. In Wiener’s statistical 
design technique, the mean-square value of the error e(t) is used as the perfor- 
mance index, J; that is, 


T 
= tim + [ e%(t) dt (10-1) 
re aa 


Controller Process 


Desired system 
(model) 


Fig. 10-4. Block diagram of control systems designed by Wiener’s optimi- 
zation technique. 


The reason for using the mean-square error as the performance index is that the 
minimization of this particular performance index induces an analytical design 
procedure which makes use of the mathematical functions already defined in the 
theory of probability and statistics. However, in practice, a system that is 
optimum in the sense of minimum mean-square error may be ideal only for 
certain situations but not for others. In fact, it is not difficult to see from Eq. 
(10-1) that the mean-square-error criterion places heavier emphasis on large 
errors than on smaller ones. 
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In reality, the configuration shown in Fig. 10-4 can be used for the analyti- 
cal design of systems with random inputs as well as systems with deterministic 
inputs. When the input signal is considered to be deterministic, other perfor- 
mance indices such as those listed below can be treated mathematically: 

J. e(t) dt f, | e(t)| dt J. tle(t)| dt 
In fact, the first of these criteria is known as the integral-square error (ISE) and 
is the most popular one used for the analytical design of control systems. The 
reason for this popularity is due to the fact that the integral is directly related 
to the Laplace transform domain through Parseval’s theorem. 

The importance of Wiener’s work and the analytical design is not so much 
because the techniques have found significant applications in control systems 
practice, but because these represent a revolution in design principle from the 
conventional trial-and-error methods. 

At approximately the same time the analytical design principle and tech- 
niques were being developed, Truxal’ proposed a synthesis procedure through 
pole~zero configuration in the s-plane. The synthesis still makes use of the con- 
ventional design specifications, such as the relative damping ratio, error constants, 
bandwidth, and rise time, and the input signals are deterministic. Based on the 
design specifications, the closed-loop transfer function of the control system is 
first determined, and then the corresponding open-loop transfer function is 
found. The advantage of this synthesis method over the classical frequency- 
domain design is that the designer is able to determine if the given set of specifi- 
cations are consistent at the beginning of the design, so the amount of guesswork 
and trial and error are cut to a minimum. Furthermore, Truxal’s synthesis starts 
with the closed-loop transfer function and then works toward the transfer func- 
tion of the controller, whereas the frequency-domain design starts out with the 
controller and then works toward the closed-loop transfer function to see if the 
design specifications are satisfied. 

It is very difficult to pinpoint exactly when the modern control systems 
theory was inaugurated. In fact, the mathematical foundation of certain aspects 
of modern control theory can be traced far back to works that were completed 
some seventy years ago. For instance, the state-variable approach to linear sys- 
tems is well known to mathematicians as the theory of solutions of first-order 
differential equations. Liapunov’s method on stability was based on his Ph.D 
thesis, which was completed in 1892. The linear programming technique, which 
has significant impact on modern control theory and practice, was developed 
about 1939. These significant contributions, among many others, did not become 
widely known until recent years because they were much too far ahead of their 
time. 

The launch of the space age has placed a challenge to the control engineer 
to find new methods of design of more complex control systems and to meet 
more rigid requirements. The control engineer soon discovered that the conven- 
tional design was no longer adequate and rigorous enough to handle the com- 
plicated problems encountered in modern fire control systems, autopilot sys- 
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tems, missile guidance systems, spacecraft rendezvous control systems, and 
many others. Modern societal systems are modeled by complex models with 
multiple inputs and outputs which are difficult to handle even with optimal con- 
trol theory. Consequently, not only new design principles have been developed, 
but many of the mathematical contributions that have long been neglected were 
rediscovered and made applicable to the practical control problems. In a sense, 
the classical control system design is truly an engineering endeavor, and the 
modern control design contains, first, the development and formulation of the 
mathematical theory, and second, the application of the mathematical princi- 
ples to practical design problems. Indeed, at present, many areas of the advanced 
control theory are still at the theoretical stage, and it is generally recognized that 
a gap still exists between theory and practice in the design of control systems. 

The objective of modern control design can be described by two words: 
optimal control. In other words, a system is to be designed so that it is optimum 
in a prescribed sense. For instance, with reference to the block diagram of the 
multivariable controlled process shown in Fig. 10-2, one of the common prob- 
lems in optimal control is to determine the control vector u(t) over the time 
interval tp < t < t, so that the state vector x(z) is brought from the initial state 
x(fy) to the desired final state x(t,) in the shortest possible time, subject to the 
given controlled process and possibly other constraints. The problem is usually 
referred to as the minimal-time problem or time-optimal problem. 

In general, the performance index J can be represented by the following 
integral: 


eal ” FIx(1), u(2), 4) dt (10-2) 

to 
where F is a scalar function. For the minimal-time problem, F is set at unity, so _ 
J=("a=t,—t (10-3) 

to 


Minimizing J is therefore equivalent to minimizing the time interval between the 
initial and the final times. 

As another example, if it is desired to drive the state vector x(t) as close as 
possible to the desired state x, over the time interval (fo, t;), while keeping the 
magnitudes of the controls within reason, the following performance index may 
be used: 


J= : {Ix@ — x,]‘Q[x() — x,] + u’(2)Ru(s)} at (10-4) 


where Q and R are symmetric matrices. 

The extensive use of applied mathematics in modern control theory has 
made it difficult for one to make a quick transition from the classical design to 
the modern. The classical design is characterized by such terminology and tools 
as transfer function, poles and zeros, frequency response, root loci, Bode plot, 
and Nyquist plot. In optimal control studies we shall find a set of new terms such 
as state variables, state equations, state transition matrix, maximum or minimum 
principle, Liapunov’s methods, gradient technique, linear programming, dyna- 
mic programming, controllability, and observability. 
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In this section we have given a brief discussion of the historical development 
of control systems theory. The discussions and reference made are by no means 
exhaustive. It is hoped that these introductory remarks will give the reader a 
general idea of the basic problems involved in the design of control systems be- 
fore entering the details on the subject of design. The remaining part of this 
chapter will contain subjects on the classical design methods. The analytical 
design method and certain aspects of optimal control are covered in Chapter 11. 


10.2 Classical Design of Control Systems 


In this section the classical design of control systems will be carried out in the 
frequency domain and the s-domain. The designs are mainly affected by means 
of Bode plot, Nichols chart, and the root locus. 

To illustrate the basic principle of the classical design, let us consider the 
following example. Let us begin by considering the transfer function of a con- 
trolled process 

K 

G(s) = ESM $0.01) ae 
The closed-loop system is considered to have a unity feedback. It is required 
that when a unit ramp input is applied to the closed-loop system, the steady-state 
error of the system does not exceed 1 per cent of the amplitude of the input ramp, 
which is unity. Thus when we use the approach discussed in Chapter 6 on steady- 
state error, we can find the minimum value of K in order to fulfill this error 
requirement: 


steady-state error = e,, = lim FAO = x < 0.01 (10-6) 
Therefore, K must be greater than 100. However, applying the Routh-Hurwitz 
criterion to the characteristic equation of the closed-loop system it is easy to 
show that the system is unstable for all values of K greater than 81. This means 
that some kind of compensation scheme or controller should be applied to the 
system so that the steady-state error and the relative stability requirements can 
be satisfied simultaneously. It is apparent that this controller must be able to 
keep the zero-frequency gain of s times the open-loop transfer function of the 
compensated system effectively at 100 while maintaining a prescribed degree of 
relative stability. The principle of the design in the frequency domain is best 
illustrated by the Nyquist plot of G,(s) shown in Fig. 10-5. In practice, we sel- 
dom use the Nyquist plot but rather the Bode plot for design, because the latter 
is easier to construct. When K = 100, the system is unstable, and the Nyquist 
plot of G,(s) is shown to enclose the (—1, 70) point. Let us assume that we desire 
to realize a resonance peak of M, = 1.25. This means that the Nyquist plot of 
G,(s) must be tangent to the constant-M circle for M = 1.25 from below. If K 
is the only parameter that we can adjust to achieve the objective of M, = 1.25, 
Fig. 10-5 shows that the desired value of K is 1. However, with this value of K, 
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Fig. 10-5. Nyquist plot for Gp(s) = K/[s(1 + s)(1 + 0.0125s)}. 


the velocity error constant is only 1 sec~!, and the steady-state error requirement 
is not satisfied. Since the steady-state performance of the system is governed 
by the characteristics of the transfer function at the low frequency, Fig. 10-5 
shows that in order to simultaneously satisfy the transient and the steady-state 
requirements, the Nyquist plot of G,(s) has to be reshaped so that the high- 
frequency portion of the locus follows the K = 1 plot and the low-frequency 
portion follows the K = 100 locus. The significance of this locus reshaping is 
that the compensated locus shown in Fig. 10-5 will be tangent to the M = 1.25 
circle at a relatively high frequency, while the zero-frequency gain is maintained 
at 100 to satisfy the steady-state requirement. When we inspect the loci of Fig. 
10-5, it is clear that there are two alternative approaches in arriving at the com- 
pensated locus: 


1. Starting from the K = 100 locus and reshaping the locus in the 
region near the resonant frequency w,, while keeping the low-fre- 
quency region of G,(s) relatively unaltered. 

2. Starting from the K = 1 locus and reshaping the low-frequency 
portion of G,(s) to obtain a velocity error constant of K, = 100 
while keeping the locus near m = q, relatively unchanged. 
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Amplitude of G, (jw) in dB 


Phase of G, (jw) 


In the first approach, the high-frequency portfon of G,(s) is pushed in the 
counterclockwise direction, which means that more phase is added to the sys- 
tem in the positive direction in the proper frequency range. This scheme is 
basically referred to as phase-lead compensation, and controllers used for this 
purpose are often of the high-pass-filter type. The second approach apparently 
involves the shifting of the low-frequency part of the K = | trajectory in the 
clockwise direction, or alternatively, reducing the magnitude of G,(s) with K = 
100 at the high-frequency range. This scheme is often referred to as phase-lag 
compensation, since more phase lag is introduced to the system in the low- 
frequency range. The type of network that is used for phase-lag compensation 
is often referred to as low-pass filters. 

Figures 10-6 and 10-7 further illustrate the philosophy of design in the fre- 
quency domain using the Bode diagram. In this case the relative stability of the 
system is more conveniently represented by the gain margin and the phase 
margin. In Fig. 10-6 the Bode plots of G,(j@) show that when K = 100, the gain 
and phase margins are both negative, and the system is unstable. When K = 1, 
the gain and phase margins are both positive, and the system has quite a com- 
fortable safety margin. Using the first approach, the phase-lead compensation, 
as described earlier, we add more phase lead to G,( ja) so as to improve the phase 
margin. However, in attempting to reshape the phase curve by use of a high- 
pass filter, the magnitude curve of G,(j@) is unavoidably altered as shown in 
Fig. 10-6. If the design is carried out properly, it is possible to obtain a net gain 
in relative stability using this approach. The Bode diagram of Fig. 10-7 serves 
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Fig. 10-6. Bode plot of Gp(s) = K/[s(1 + s)(t + 0.0125s)] with phase-lead 
compensation. 
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Fig. 10-7. Bode plot of G,(s) = K/{s(l + s)(1 + 0.0125s)] with phase-lag 
compensation. 


to illustrate the principle of phase-lag compensation. If, instead of adding more 
positive phase to G,( ja) at the high-frequency range as in Fig. 10-6, we attenuate 
the amplitude of G,( ja) at the low frequency by means of a low-pass filter, a 
similar stabilization effect can be achieved. The Bode diagram of Fig. 10-7 shows 
that if the attenuation is affected at a sufficiently low frequency range, the effect 
on the phase shift due to the phase-lag compensation is negligible at the phase- 
crossover frequency. Thus the net effect of the compensating scheme is the 
improvement on the relative stability of the system. 

It will be shown later that the transfer function of a simple passive network 
controller can be represented in the form of 


_—s+2; - 
GAs) = aaary (10-7) 
where for a high-pass filter, p, > z,, and for a low-pass filter, p, < z,. Using 
this transfer function, it is now possible to explain the two basic approaches of 
compensation using the root locus diagram. 

The root locus diagram of the closed-loop control system which has the 
G,(s) of Eq. (10-5) as its open-loop transfer function is shown in Fig. 10-8. 
The root loci clearly indicate the instability condition when K = 100. Using the 
phase-lead compensation, with the transfer function of Eq. (10-7), p, > 2), 
the resulting root loci are shown in Fig. 10-8. If the values of z, and p, are chosen 
appropriately, the complex roots of the closed-loop system with K = 100 may 
be moved into the left half of the s-plane. 
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Fig. 10-8. Root locus diagrams of Gp(s) = K/[s(1 + s)(1 + 0.0125s)] and 
G.(s)G,(s) = [K(s + z1)I/[s(s + pd +s) + 0.0125s)] (py > z;). 


The root locus diagram of Fig. 10-9 illustrates the principie of phase-lag 
compensation in the s-domain. In this case p, is chosen to be less than z,, but 
for effective control, the two values are chosen to be very close to each other and 
are relatively small. Because of the closeness of z, and p,, the portion of the root 
loci that represents the dominant eigenvalues of the system are not much affected 
by the compensation. However, the stability of the compensated system is im- 
proved since the points at which K = 100 are shifted into the left half of the 
s-plane. Details of the design using the above mentioned techniques are given in 
the following sections. One should not be misled that any given control system 
can always be compensated satisfactorily by either of the two schemes discussed 
here. It will be shown that, for systems with certain characteristics, satisfactory 
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Fig. 10-9. Root locus diagrams of G)(s) = K/[s(1 +5) + 0.0125s)] and 
G(s)G p(s) = [K(s + zi)I/{s(s + pil + (1 + 0.0125s)] (91 < 21). 


compensation cannot be accomplished by phase-lead networks alone. However, 
this does not mean that proper compensation may then be achieved by using 
phase-lag networks, for it is quite common that neither scheme is feasible, and 
some combination of lead and lag characteristics is needed. 


10.3. Phase-Lead Compensation 


In Chapter 6 a simple phase-lead compensation scheme using the transfer func- 
tion (1 + Ts) was described under the name “derivative control.” Although this 
transfer function represents the simplest configuration for a phase-lead scheme, 
in practice, (1 + Ts) cannot be realized as a transfer function by any passive 
network. A practical and simple phase-lead network is shown in Fig. 10-10. 
Although the network may be simplified still further by eliminating R,, such a 
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Fig. 10-10. Passive phase-lead network. 


network would block dc signals completely and cannot be used as a series com- 
pensator for a control system. 

The transfer function of the network is derived as follows by assuming that 
the source impedance which the lead network sees is zero, and the output load 
impedance is infinite. This assumption is necessary in the derivation of the 
transfer function of any four-terminal network. 


E,(s) es R, + R,R,Cs (10-8) 


E,(s) > R, TT R, + R,R,Cs 
or 
E,(s)_ __-R, 1+ RCs 10-9 
E,(s) Ri + Rz 14+ RR, Cs ( ) 
R, +R, 
Let 
eS eS S| (10-10) 
R, 
and 
R,R 
T => ++ C 10-11 
RR Oe 
then Eq. (10-9) becomes 
Es) 1 1+-aTs : 
EQ sire “ser! CO) 


In the following sections, the characteristics of the RC phase-lead network 
and various design considerations are considered. 


Characteristics of the RC Phase-Lead Network 


Pole-zero configuration of the RC phase-lead network. As seen from Eq. 
(10-12), the transfer function of the phase-lead network has a real zero at 
Ss = —]/aT anda real pole at s = —1/T. These are represented in the s-plane as 
shown in Fig. 10-11. By varying the values of a and 7, the pole and zero may be 
located at any point on the negative real axis in the s-plane. Since a > 1, the 
zero is always located to the right of the pole, and the distance between them is 
determined by the constant a. 


Polar plot of the RC phase-lead network. When using the RC phase-lead 
network of Fig. 10-10 as a compensator for control systems, the attenuation, 
1/a, of Eq. (10-12) is overcome by the amplifier gain of the system, so it is neces- 
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Fig. 10-11. Pole-zero configuration of a passive phase-lead network. 
Ex(s)/Ei(s) = (1/a)(1 + aTs)/(1 + Ts). 


sary only to investigate the transfer function 


E,(s)__ 14+ aTs 
EG) Lets (10-13) 
The polar plot of Eq. (10-13) is shown in Fig. 10-12 for several different 
values of a. For any particular value of a, the angle between the tangent line 
drawn from the origin to the semicircle and the real axis gives the maximum 
phase lead @¢,, which the network can provide. The frequency at the tangent 
point, w,,, represents the frequency at which ¢,, occurs. It is seen that, as @ in- 
creases, the maximum phase lead, ¢,,, also increases, approaching a limit of 90° 
as a approaches infinity. The frequency w,, decreases with the increase in a. 


a 


4, <4, < 43 


Fig. 10-12. Polar plot of a[E2(s)/E1(s)] = (1 + a7s)/(1 + Ts). 
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Bode plot of the RC phase-lead network. In terms of the Bode plot, the 
RC network of Fig. 10-10 has two corner frequencies: a positive corner fre- 
quency at wm = l|/aT and a negative corner frequency at w =- 1/T. The Bode 
diagram of aE,(jw)/E,(jw) is shown in Fig. 10-13. 


aE, 
| a 20 dB/decade 20 log, 9a 
dB 
w 
0 =o w@ id 
aT T 


Fig. 10-13. Bode plot of the phase-lead network aE2(s)/E1(s) = (1 + aTs)/ 
(1 + Ts) (a > 1). 


Analytically, ¢,, and w,, may be related to the parameters a and T. Since @,, 
is the geometric mean of the two corner frequencies, we can write 


1 1 1 
10819 Om = + (lo8i0 ar + logio rT) (10-14) 
Thus 
1 
== 10-1 
On = TF (10-15) 
To determine the maximum phase lead, ¢,,, we write the phase of aE,(ja)/ 
E, (ja) as 
a E,U0)] _ tan-! aT@ — tan-' Te : 
@ = Arg [ age an”! aT@ — tan"! Ta (10-16) 
from which we have 
aTw — To 
tang = (10-17) 


I + (aT@\(To) 
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When ¢ = 9, 
1 
=O, =—= 10-18 
O=On Tat ( ) 
Therefore, Eq. (10-17) gives 
— (a—1)0/./a)_a—1 é 
tan ¢, Tei a (10-19) 
or 
sin b, = a (10-20) 


This last expression is a very useful relationship in the proper selection of the 
value of a for compensation design. 


Design of Phase-Lead Compensation by the Bode Plot Method 


Design of linear control systems in the frequency domain is more pref- 
erably carried out with the aid of the Bode plot. The reason is simply because 
the effect of the compensation network is easily obtained by adding its magnitude 
and phase curves, respectively, to that of the original process. For the phase- 
lead compensation employing the RC network of Fig. 10-10, the general outline 
of the design procedure is as follows. It is assumed that the design specifications 
simply include a steady-state error and phase margin-versus-gain margin re- 
quirements. 


1. The magnitude and phase-versus-frequency curves for the uncom- 
pensated process G,(s) are plotted with the gain constant K set 
according to the steady-state error requirement. 

2. The phase margin and the gain margin of the original system are 
read from the Bode plot, and the additional amount of phase lead 
needed to provide the required degree of relative stability is deter- 
mined. From the additional phase lead required, the desired 
value of ¢,, is estimated accordingly, and a is calculated from Eq. 
(10-20). 

3. Once a is determined, it is necessary only to obtain the proper value 
of 7, and the design is in principle completed. The important step is 
to place the corner frequencies of the phase-lead network, 1/aT, 
and 1/T such that @¢,, is located at the new gain-crossover frequency. 

4. The Bode plot of the compensated system is-investigated to check 
that all performance specifications are met; if not, a new value of @,, 
must be chosen and the steps repeated. 

5. If the specifications are all satisfied, the transfer function of the 
phase-lead network is established from the values of a and T. 


The following numerical example will illustrate the steps involved in the 
phase-lead design. 
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EXAMPLE 10-1. Consider the sun-seeker control system described in Section 5.13. 
The block diagram of the system is shown in Fig. 10-14. It is assumed 
that for small signal, the error discriminator can be approximated 

by a linear gain; that is, 


-a___“t —- K, = constant (10-21) 
The tachometer in the original system has also been eliminated for the present design 


problem. A block representing the controller, in case it is needed, is inserted 
between the two amplifiers. The parameters of the system are given as 


Ry = 10,000 
K, = 0.0125 volt/rad/sec 
K,, = 0.0125 newton-m/amp 
R, = 6.25Q 
J = 10-6 kg-m? 
K, = 0.1 amp/rad 
K = variable 
B=0 
n = 800 
The open-loop transfer function of the uncompensated system is written 
O.(s)_ _K,RrKK,[n 


“A(s) ~ Rods? + Km Kos (10-22) 
Substituting the numerical values of the system parameters, Eq. (10-22) gives 
Oo(s) __ _-2500K 
“a(s) ~ s(¢ F 25) are) 


The specifications of the system are given as 


1. The phase margin of the system should be greater than 45°. 

2. The steady-state error of &(¢) due to a unit ramp function input should be 
less than or equal to 0.01 rad per rad/sec of the final steady-state output 
velocity. In other words, the steady-state error due to a ramp input should 
be less than or equal to 1 per cent. 


The following steps are carried out in the design of the phase-lead compensation: 


1. Applying the final-value theorem, we have 


6,(s) 


py eath ) = lim sO) ? 
Min ae) == lime ss) = 10 ST [Oo] ae 

Since 9,(s) = 1/s?, using Eq. (10-23), Eq. (10-24) becomes 
lim a(t) = 0.01/K (10-25) 


Thus we see that if K = 1, we have the steady-state error equal to 0.01. 
However, for this amplifier gain, the damping ratio of the closed-loop 
system is merely 25 per cent, which corresponds to an overshoot of over 
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1.0 


Without compensation 


1 + 0.0262; 


With phase-lead compensation, G,(s) = T+0.0100s 


1 + 0.034275 


With phase-lead compensation, G,(s) = 1+0 005885 


0.1 0.2 0.3 0.4 


Time (seconds) 


Fig. 10-15. Step responses of the sun-seeker system in Example 10-1. 


44.4 per cent. Figure 10-15 shows the unit step response of the closed-loop 
system with K = 1. It is seen that the step response is quite oscillatory. 


. The Bode plot of @(s)/a(s) of the uncompensated system, with K = 1, is 


sketched as shown in Fig. 10-16. 


. The phase margin of the uncompensated system, read at the gain-crossover 


frequency, @, = 50 rad/sec, is 25°. Since the phase margin is less than the 
desired value of 45°, more phase lead should be added to the open-loop 
system. 


. Let us choose to use the phase-lead network of Fig. 10-10 as the controller. 


Then, the transfer function for the controller of Fig. 10-14 is 


U(s) _ 1 + aTs 
E,(s) 1 + Ts 


As mentioned earlier, the attenuation, 1/a, accompanied by the phase- 
lead network is assumed to be absorbed by the other amplifier gains. 
Since the desired phase margin is 45° and the uncompensated system has 


GAs) = (10-26) 


a phase margin of 25°, the phase-lead network must provide the additional 
20° in the vicinity of the gain-crossover frequency. However, by inserting the 
phase-lead network, the magnitude curve of the Bode plot is also affected in 


20 


dB 0 


— 20 


— 90° 


~ 180° 
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GW) as) s(1 + 0.04s) 


(1 +.0.0262s) 
G.(S) = (T+ 0.0106s) 


100(1_+ 0.0262s) 


G(s) = + 0.045)(1 + 0.01065) 


Phase of lead network 
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sy Phase of compensated system 
Phase of original system 


Phase margin of original system 
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Fig. 10-16. Bode plots of compensated and uncompensated systems in 
Example 10-1. 


such a way that the gain-crossover frequency is shifted to a higher frequency. 
Although it is a simple matter to adjust the corner frequencies, 1/aT and 1/T, 
so that the maximum phase of the network, }m, falls exactly at the new gain- 
crossover frequency, the original phase curve at this point is no longer 25°, 
and could be considerably less. This represents one of the main difficulties in 
the phase-lead design. In fact, if the phase of the uncompensated system 
decreases rapidly with increasing frequency near the gain-crossover frequency, 
phase-lead compensation may become ineffective. 

In view of the above mentioned difficulty, when estimating the necessary 
amount of phase lead, it is essential to include some safety margin to account 
for the inevitable phase dropoff. Therefore, in the present design, instead of 
selecting a @,, of 20°, we let dn be 25°. Using Eq. (10-20), we have 
a—1 


sin @m = sin 25° = 0.422 = al 


(10-27) 


from which we get 
a= 2.46 (10-28) 


5. To determine the proper location of the two corner frequencies, 1/a@T and 
1/T, it is known from Eq. (10-18) that the maximum phase lead @,, occurs 
at the geometrical mean of the corners. To achieve the maximum phase 
margin with the value of a already determined, ¢,, should occur at the new 
gain-crossover frequency @!, which is not known. Thus the problem now 
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is to locate the two corner frequencies so that ¢,, occurs at @. This may be 
accomplished graphically as follows: 
(a) The zero-frequency attenuation of the phase-lead network is calcu- 
lated: 
20 logioa = 20 log, 2.46 = 7.82 dB (10-29) 


(b) The geometric mean ,, of the two corner frequencies 1/aT and 1/T 
should be located at the frequency at which the magnitude of the 
uncompensated transfer function 0o(j@)/a(ja) in decibels is equal to 
the negative value in decibels of one half of this attenuation. This way, 
the magnitude plot of the compensated transfer function will pass 
through the 0-dB axis at @ = @,,. Thus @,, should be located at the 
frequency where 


O(j@)|__—7.82 
a(j@)| 2 


= —3,91 dB (10-30) 


From Fig. 10-16, this frequency is found to be w,, -= 60 rad/sec. Now 
using Eq. (10-15), we have 


+ = J Wm = 246 X 60 = 94 rad/sec (10-31) 


Then 
1 
ar > 38.2 rad/sec (10-32) 
The parameters of the phase-lead controller are now determined. Figure 10-16 
shows that the phase margin of the compensated system is approximately 48°. The 
transfer function of the phase-lead network is 


U(s)_11+aTs_ 1 1+0.0262s 
Es) a 1 -- Ts ~ 3461 + 0.0106s 


(10-33) 


Since it is assumed that the amplifier gains are increased by a factor of 2.46, the 
open-loop transfer function of the compensated sun-seeker system becomes 


O(s) __ 6150(s + 38.2) 
Os) ~ s(s + 25)(s + 94) 


In Fig. 10-17 the magnitude and phase of the original and the compensated sys- 
tems are plotted on the Nichols chart. These plots are obtained by taking the data 
directly from the Bode plot of Fig. 10-16. From the Nichols chart, the resonance peak, 
M,, of the uncompensated system is found to be 1.88, or 5.5 dB. The value of M, with 
compensation is 1.175, or 1.4 dB. One more important point is that the resonant 
frequency of the system is decreased from 50 rad/sec to approximately 37 rad/sec, but 
the bandwidth is increased from 70 rad/sec to 110 rad/sec. 

The unit step response of the compensated system is shown in Fig. 10-15. Note that 
the response of the system with the phase-lead controller is far less oscillatory than 
that of the original system. The overshoot is reduced from 44.4 per cent to 24.5 per 
cent, and the rise time is also reduced. The reduction of the rise time is due to the 
increase of the bandwidth by the phase-lead controller. On the other hand, excessive 
bandwidth may be objectionable in certain systems where noise and disturbance 
signals may be critical. 

In the present design problem, we notice that a specification of 45° for the phase 
margin yields an overshoot of 24.5 per cent in the step response. To demonstrate the 
capability of the phase-lead controller, we select a to be 5.828. The resulting controller 


(10-34) 
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Fig. 10-17. Plots of G(s) in Nichols chart for the system in Example 10-1. 
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Fig. 10-18. Closed-loop frequency responses of the sun-seeker system in 
Example 10-1. 


(a) G(s) = 
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s(s + 25) 


Fig. 10-19. Root locus diagrams of the sun-seeker system in Example 10-1. 
(a) Uncompensated system. 
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Fig. 10-19 (Cont.). (b) Compensated system with phase-lead controller. 


has the transfer function 
1 1+ 0.034275 
5,828 1 + 0.005885 (10-35) 


The unit step response of the compensated system is plotted as shown in Fig. 10-15. 
In this case the rise time is shorter still, and the peak overshoot is reduced to 7.7 per 
cent. 

Using the magnitude-versus-phase plots and the Nichols chart of Fig. 10-17, the 
closed-loop frequency responses for the sun-seeker system, before and after compen- 
sation, are plotted as shown in Fig. 10-18. 

To show the effects of the phase-lead compensation, the root locus diagrams of 
the system, before and after compensation, are shown in Fig. 10-19, It is clear from 
these diagrams that the phase-lead compensation has the effect of bending the complex 
root loci toward the left, thus improving the stability of the system. The eigenvalues of 
the compensated closed-loop system are at s = —45.5, —36.7 + j61.7, and —36.7 
— j61.7. Therefore, the damping ratio of the complex eigenvalues of the compensated 
system is approximately 50 per cent. 

In general, it is difficult to visualize how the phase-lead design can be carried out 
with the root locus method independently. The root loci of Fig. 10-19 are drawn based 
on the results of the Bode plot design. In the following section, we shall illustrate a 
procedure of designing phase-lead compensation using the root contour method. 


G(s) = 
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Design of Phase-Lead Compensation by the Root Locus Method 


The root contour method can be used for the design of control systems. 
Let us use the sun-seeker system studied in Example 10-1 to illustrate the design 
procedure. 

The open-loop transfer function of the uncompensated system is 


Oo(s) _ _ 2500 : 
as) G(s) Xe + 25) (10-36) 
The characteristic equation of the closed-loop system is 
s* + 25s + 2500 = 0 (10-37) 


and the eigenvalues are s, = —12.5 + j48.4 and s, = —12.5 — 48.4. 

The open-loop transfer function of the system with phase-lead compensa- 
tion is written 

2500(1 + aTs) 

s(s + 25)(1 + Ts) 
The problem is to determine the values of a and T so that the system will perform 
as desired. In this case, rather than using the frequency-domain specifications, 
such as the phase margin and gain margin, it is more convenient to specify the 
relative positions of the complex eigenvalues. 

To begin with the root contour design, we first set a to zero in Eq. (10-38). 
Then, the characteristic equation of the compensated system becomes 


s(s + 25)(1 + Ts) + 2500 = 0 (10-39) 


Since T is the variable parameter, we divide both sides of Eq. (10-39) by the terms 
that do not contain 7. We have 


G(s) = (10-38) 


Ts%(s+ 25) __ 

1 ts = 9 10-40) 
This equation is of the form of 1 + G,(s) = 0, where G,(s) is an equivalent 
transfer function that can be used to study the root loci of Eq. (10-39). The root 
contour of Eq. (10-39) is drawn as shown in Fig. 10-20, starting with the poles 
and zeros of G(s). Of significance is that the poles of G,(s) are the eigenvalues 
of the system when a = 0 and T = 0. As can be seen from the figure, the factor 
1 + Ts in the denominator of Eq. (10-38) alone would not improve the system 
performance at all. In fact, the eigenvalues of the system are moved toward the 
right half of the s-plane, and the system becomes unstable when T is greater than 
0.0133. To achieve the full effect of the phase-lead compensation, we must re- 
store the value of a in Eq. (10-38). The characteristic equation of the compen- 
sated system now becomes 


s(s + 25). + Ts) + 2500(1 + aTs) = 0 (10-41) 

Now we must consider the effect of varying a while keeping T constant. 

This is accomplished by dividing both sides of Eq. (10-41) by the terms that do 
not contain a. We have 


i+ 2500aTs 


as + 251 + Ts) + 2500 ~ ° 


(10-42) 
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Fig. 10-20. Root contours of the sun-seeker system of Example 10-1 with 
a = 0, and T varies from 0 to ©o. 


This equation is again of the form of 1 + G,(s) = 0, and for a given 7, the root 
loci of Eq. (10-41) can be obtained based upon the poles and zeros of 


_ 2500aT's | 
GAS) = 55) + Ts) 4 2500 (10-43) 


Notice also that the denominator of G,(s) is identical to the left side of Eq. 
(10-39), which means that the poles of G,(s) must lie on the root contours of Fig. 
10-20, for a given T. In other words, the root contours of Eq. (10-41) as a varies 
must start from the points on the trajectories of Fig. 10-20. These root contours 
end at s = 0, 00, oo, which are the zeros of G,(s). The complete root contours 
of the system with phase-lead compensation are now sketched in Fig. 10-21. 
From the root contours of Fig. 10-21, we can see that for effective phase- 
lead compensation, the value of T should be small. For large values of T, the 
bandwidth of the system increases very rapidly as a increases, while very little 
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Fig. 19-21. Root contours of the sun-seeker system with a phase-lead con- 
troller, G.(s) = (1 + aTs)/(1 + Ts), Example 10-1. 


improvement is made on the damping of the system. We must remember that 
these remarks are made with respect to the phase-lead design that corresponds 
to values of a greater than unity. 


Effects and Limitations of Phase-Lead Compensation 


From the results of the last illustrative example, we may summarize the 
general effects of phase-lead compensation on the performance of control sys- 
tems as follows: 


1. The phase of the open-loop transfer function in the vicinity of the 
gain-crossover frequency is increased. Thus the phase margin is 
usually improved. 

2. The slope of the magnitude curve representing the magnitude of the 
open-loop transfer function is reduced at the gain-crossover fre- 
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quency. This usually corresponds to an improvement in the relative 
stability of the system. In other words, the phase and gain margins 
are improved. 

3. The bandwidths of the open-loop system and the closed-loop system 
are increased. 

4. The overshoot of the step response is reduced. 

5. The steady-state error of the system is not affected. 


It was mentioned earlier that certain types of systems cannot be effectively 
compensated satisfactorily by phase-lead compensation. The sun-seeker system 
studied in Example 10-1 happens to be one for which phase-lead control is 
effective and practical. In general, successful application of phase-lead compen- 
sation is hinged upon the following considerations: 


1. Bandwidth considerations: If the original system is unstable, the 
additional phase lead required to obtain a certain desirable phase 
margin may be excessive. This requires a relatively large value of a 
in Eq. (10-12), which, as a result, will give rise to a large bandwidth 
for the compensated system, and the transmission of noise may 
become objectionable. Also, if the value of a becomes too large, the 
values of the network elements of the phase-lead network may be- 
come disproportionate, such as a very large capacitor. Therefore, in 
practice, the value of a is seldom chosen greater than 15. If a larger 
value of a is justified, sometimes two or more phase-lead controllers 
are connected in cascade to achieve the large phase lead. 

2. If the original system is unstable or has low stability margin, the 
phase plot of the open-loop transfer function has a steep negative 
slope near the gain-crossover frequency. In other words, the phase 
decreases rapidly near the gain crossover. Under this condition, 
phase-lead compensation usually becomes ineffective because the 
additional phase lead at the new gain crossover is added to a much 
smaller phase angle than that at the old gain crossover. The desired 
phase margin may be realized only by using a very large value of a. 
However, the resulting system may still be unsatisfactory because a 
portion of the phase curve may still be below the 180° axis, which 
corresponds to a conditionally stable system. 


In general, the following situations may also cause the phase to change 
rapidly near the gain-crossover frequency: 


1. The open-loop transfer function has two or more poles that are close 
to each other and are close to the gain-crossover frequency. 

2. The open-loop transfer function has one or more pairs of complex 
conjugate poles near the gain-crossover frequency. 


The following example will illustrate a typical situation under which phase- 
lead compensation is ineffective. 
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EXAMPLE 10-2 Let the open-loop transfer function of a control system with unity 
feedback be 
K 
GAS) = SEOs + 0.25) (10-44) 


It is desired that the system satisfies the following performance specifications: 


1, K, = 100; or the steady-state error of the system due to a unit ramp 
function input is 0.01 in magnitude. 
2. Phase margin > 40°. 
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Fig. 10-22. Bode plots of G,(s) = 100/[s(1 + 0.1s)(1 + 0.2s)] and the 
effects of using phase-lead compensation. 
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From the steady-state error requirement, we set K = 100. The Bode plot of 
G,(s) when K = 100 is shown in Fig. 10-22. As observed from this Bode plot, the phase 
margin of the system is approximately —40°, which means that the system is unstable. 
In fact, the system is unstable for all values of K greater than 15. The rapid decrease of 
phase at the gain-crossover frequency, @, = 17 rad/sec, implies that the phase-lead 
compensation may be ineffective for this case. To illustrate the point, the phase-lead 
network of Fig. 10-10 and Eq. (10-12) with a = 4.6, 14, and 100, respectively, is used 
to compensate the system. Figure 10-22 illustrates the effects of phase-lead compen- 
sation when the values of T are chosen according to the procedure described in Example 
10-1. 

It is clearly shown in Fig. 10-22 that as more phase lead is being added, the gain- 
crossover frequency is also being pushed to a higher value. Therefore, for this case, in 
which the uncompensated system is very unstable at the outset, it may be impossible to 
realize a phase margin of 40° by the phase-lead network of Fig. 10-10. 

In a similar fashion, we may use the root contour method to illustrate why the 
phase-lead compensation is ineffective in this case of a highly unstable system. Figure 
10-23 shows the root locus diagram of the uncompensated system with the process 
described by the transfer function of Eq. (10-44). When K = 100, the two complex 
eigenvalues of the closed-loop system are at s = 3.8 + /14.4 and 3.8 — j14.4. 


— 77.07 (K = 15) 


Fig. 10-23. Root loci of s(s + 5s + 10) + 50K = 0. 
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Let the controller be represented by 


_ 1+ aTs 
GAs) = Tits a> 1 (10-45) 
Then, the open-loop transfer function becomes 
5000(1 + aTs) 


G.(s)G,(s) = (10-46) 


s(s + 5)(s + 10)(1 + Ts) 


Fig. 10-24. Root contours of s(s + 5)(s + 10)(1 + Ts) + 5000 = 0, and 
of s(s + 5)(s + 10)(1 + Ts) + 5000(1 + aTs) = 0. 
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First, we set a = 0 while we vary T from zero to infinity. The characteristic equa- 
tion becomes 
s(s + 5)(s + 10)(1 + Ts) + 5000 = 0 (10-47) 


The root contours of Eq. (10-47) are constructed from the pole—zero configuration of 


Ts2(s + 5\(s + 10) 
s(s + 5)(s + 10) + 5000 


Thus, in Fig. 10-24 the poles of G,(s) are labeled as T = 0 points, and the zeros of 
G,(s) are points at which T = oo, ; 

Next, we restore the value of a in Eq. (10-46), and the root contours of Eq. (10-47) 
become the trajectories on which a = 0. In other words, the characteristic equation of 
the overall system is written 


s(s + 5)(s + 10)(1 + Ts) + 5000(1 + a7Ts) =0 (10-49) 


When a is considered the variable parameter, we divide both sides of Eq. (10-49) by the 
terms that do not contain a; we have 


5000aTs a 
s(s + 5)(s + 10) + Ts) + 5000 ~ 


Thus, as we have stated, the root contours with a varying, start (a = 0) at the poles of 


5000aTs 

s(s + 5)(s + 10) + Ts) + 5000 

The dominant part of the root loci of Eq. (10-49) is sketched in Fig. 10-24. Notice 
that, since for phase-lead compensation the value of a is limited to greater than 1, the 
root contours that correspond to this range are mostly in the right-half plane. It is 
apparent from this root contour plot that the ineffectiveness of phase-lead compensa- 
tion, in this case, may be attributed to the eigenvalues of the uncompensated system 
being in the right-half plane. 

We shall show in the following that for the system considered in this example, it 
is far more effective to compensate it by a phase-lag network, or by means of an auxil- 
iary feedback loop. 


Gi(s) = (10-48) 


1+ 0 (10-50) 


G2(s) = (10-51) 


10.4 Phase-Lag Compensation 


In contrast to using a high-pass filter as a compensator for control systems, we 
may use a low-pass filter for similar purposes. Figure 10-25 shows a simple RC 
network that may be used for the low-pass or phase-lag compensation of con- 
trol systems. If we assume that the input impedance of 
the network is zero and that the output impedance which 


Ry the network sees is infinite, the transfer function of the 
° # network is 
E,(s) _ 1+ R,Cs z 
Ry EG) ~TTQ@, +R  —«10-52) 
FL #) Let 
Cc aT = R,C (10-53) 
and 
= l = _ oR 
a a<l (10-54) 


Fig. 10-25. RC phase-lag network. ~ R, +R, 
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Equation (10-52) becomes 


E,(s) 1+ aTs q 
EQ-=teT 7<! (10-55) 


Characteristics of the RC Phase-Lag Network 


Pole-zero configuration of the RC phase-lag network, The transfer function 
of the phase-lag network of Fig. 10-25 has a real zero at s == —1/aT and a real 
pole at s = —1/T. As shown in Fig. 10-26, since a is less than unity, the pole is 
always located to the right of the zero, and the distance between them is deter- 
mined by a. 


jw 


s-plane 


Fig. 10-26. Pole—zero configuration of the transfer function (1 + aTs)/(1 
+ Ts), a < 1, of a phase-lag network. 


Polar plot of the RC phase-lag network. As seen from Eq. (10-52), the 
transfer function of the phase-lag network does not have any attenuation at 
zero frequency, contrary to the case of the phase-lead network. 

When we let s = jaw, Eq. (10-55) becomes 


E,jo) _ 1+ joaT 
E\(j@) 1+ joT 


The polar plot of this transfer function is shown in Fig. 10-27 for three 
values of a, 1 > a, > a, > a3. Just as in the case of the phase-lead network, for 
any value of a(a < 1), the angle between the tangent line drawn from the origin 
to the semicircle and the real axis gives the maximum phase lag ¢,, (¢,, < 0°) 
of the network. As the value of a decreases, the maximum phase lag ¢,, becomes 
more negative, approaching the limit of —90° as a approaches zero. As the 
value of a decreases, the frequency at which @,, occurs, w,,, increases; that is, 
in Fig. 10-26, @,,3 > On2 > Omi- 


a<l (10-56) 
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Fig. 10-27. Polar plots of F2(s)/Ei(s) = (1 + aTs)/(1 + Ts) (a < 1). 


Bode plot of the RC phase-lag network. The Bode plot of the transfer 
function of Eq. (10-56) is shown in Fig. 10-28. The magnitude plot has a posi- 
tive corner frequency at @ = 1/aT, and a negative corner frequency at @ = 1/T. 
Since the transfer functions of the phase-lead and phase-lag networks are identi- 
cal in form except for the zero-frequency attenuation and the value of a, it can 


i _t. 
T Wm aT 


E, — 20 dB/decade 
E, slope 
dB 20 log, oa 


Fig. 10-28. Bode plot of the phase-lag network E2(s)/E,(s) = (1 + aTs)/(1 
+ Ts) (a < 1). 
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readily be shown that the maximum phase lag @,, of the phase curve of Fig. 10-28 
satisfies the following relation: 


sin $, = 2 : (10-57) 


Design of Phase-Lag Compensation by Bode Plot 


Unlike the design of phase-lead compensation, which utilizes the maximum 
phase lead of the network, the design of phase-lag compensation utilizes the 
attenuation of the network at the high frequencies. It was pointed out earlier 
that, for phase-lead compensation, the function of the network is to increase 
the phase in the vicinity of the gain-crossover frequency while keeping the 
magnitude curve of the Bode plot relatively unchanged near that frequency. 
However, usually in phase-lead design, the gain crossover frequency is increased 
because of the phase-lead network, and the design is essentially the finding of a 
compromise between the increase in bandwidth and the desired amount of 
relative stability (phase margin or gain margin). In phase-lag compensation, 
however, the objective is to move the gain-crossover frequency to a lower fre- 
quency while keeping the phase curve of the Bode plot relatively unchanged at 
the gain-crossover frequency. 

The design procedure for phase-lag compensation using the Bode plot is 
outlined as follows: 


1. The Bode plot of the open-loop transfer function of the uncom- 
pensated system is made. The open-loop gain of the system is set 
according to the steady-state error requirement. 

2. The phase margin and the gain margin of the uncompensated system 
are determined from the Bode plot. For a certain specified phase 
margin, the frequency corresponding to this phase margin is found 
on the Bode plot. The magnitude plot must pass through the 0-dB 
axis at this frequency in order to realize the desired phase margin. 
In other words, the gain-crossover frequency of the compensated 
system must be located at the point where the specified phase margin 
is found. 

3. To bring the magnitude curve down to 0 dB at the new prescribed 
gain-crossover frequency, w,, the phase-lag network must provide 
the amount of attenuation equal to the gain of the magnitude curve 
at the new gain-crossover frequency. In other words, let the open- 
loop transfer function of the uncompensated system be G,(s); then 


|G,( ja.) |= —20log;,a dB a<l (10-58) 
from which 
@ == 1711/20 a<l (10-59) 
4. Once the value of a is determined, it is necessary only to select the 
proper value of 7 to complete the design. Up to this point, we have 


assumed that although the gain-crossover frequency is altered by 
attenuating the gain at w,, the original phase curve is not affected. 
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This is not possible, however, since any modification of the magni- 
tude curve will bring change to the phase curve, and vice versa. 
With reference to the phase characteristics of the phase-lag network 
shown in Fig. 10-28, it is apparent that if the positive corner fre- 
quency, 1/aT, is placed far below the new gain-crossover frequency, 
q@,, the phase characteristics of the compensated system will not be 
appreciably affected near w, by phase-lag compensation. On the 
other hand, the value of 1/aT should not be too much less than @}, or 
the bandwidth of the system will be too low, causing the system to 
be too sluggish. Usually, as a general guideline, it is recommended 
that the corner frequency 1/aT be placed at a frequency that is 
approximately 1 decade below the new gain-crossover frequency, 
q/,; that is, 


a = re rad/sec (10-60) 

Therefore, 
1 _ d 10-61 
F = 62 rad/sec (10-61) 


5. The Bode plot of the phase-lag compensated system is investigated 
to see if the performance specifications are met. 

6. If all the design specifications are met, the values of a and 7 are sub- 
stituted in Eq. (10-55) to give the desired transfer function of the 
phase-lag network. 


EXAMPLE 10-3 In this example we shall design a phase-lag controller for the sun- 
seeker system considered in Example 10-1. The open-loop transfer 
function of the sun-seeker system is given by Eq. (10-23), 
9.(s)__ _2500K 
a(s)  s(s + 25) 


The specifications of the system are repeated as follows: 


(10-62) 


1. The phase margin of the system should be greater than 45°. 

2. The steady-state error of &(t) due to a unit ramp function input should be 
less than or equal to 0.01 rad/rad/sec of the final steady-state output 
velocity. This is translated into the requirement of K > 1. 


The Bode plot of @o(s)/a(s) with K = 1 is shown in Fig. 10-29. As seen, the phase 
margin is only 25°. 

For a phase-lag compensation, let us choose the network of Fig. 10-25, whose 
transfer function is 


Eas = 6.) = 4 ae a<1 (10-63) 
From Fig. 10-29 it is observed that the desired 45° phase margin can be obtained if the 
gain-crossover frequency @/, is at 25 rad/sec. This means that the phase-lag controller 
must reduce the magnitude of 09(j@)/a(j@) to OdB at w = 25 rad/sec, while it does 
not appreciably affect the phase curve in the vicinity of this frequency. Since, actually, 
a small negative phase shift is still accompanied by the phase-lag network at the new 
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Fig. 10-29. Bode plots of compensated and uncompensated systems in 
Example 10-3. 


gain-crossover frequency, it is a safe measure to choose this new gain-crossover fre- 
quency somewhat less than 25 rad/sec, say, 20 rad/sec. 

From the magnitude plot of 89(j@)/a( ja), the value of | 99(ja@)/a(j@) | at e!, = 20 
rad/sec is 14 dB. This means that the phase-lag controller must provide an attenuation 
of 14 dB at this frequency, in order to bring the magnitude curve down to 0 dB at 
c!, = 20 rad/sec. Thus, using Eq. (10-59), we have 


= 107 lol fore’) /ee Joe’ 1/20 
=10-°7 =0,2 


The value of a indicates the required distance between the two corner frequencies of the 
phase-lag controller, in order that the attenuation of 14 dB is realized. 

In order that the phase lag of the controller does not appreciably affect the phase 
at the new gain-crossover frequency, we choose the corner frequency 1/aT to be at 1 
decade below w/, = 20 rad/sec. Thus 


(10-64) 


1 
10 10 = 2 rad/sec (10-65) 
which gives 7 


a 0.4 rad/sec (10-66) 


Sec. 10.4 Phase-Lag Compensation / 541 


The transfer function of the phase-lag controller is 


U(s) _ 1+0.5s 


Eo(s) > 12.55 Ue) 
and the open-loop transfer function of the compensated system is 


as)  s(s + 0.4\(s + 25) 


The Bode plot of the open-loop transfer function of the compensated system is 
shown in Fig. 10-29. We see that the magnitude curve beyond @ = 0.4 rad/sec is attenu- 
ated by the phase-lag controller while the low-frequency portion is not affected. In the 
meantime, the phase curve is not much affected by the phase-lag characteristic near the 
new gain-crossover frequency, which is at 25 rad/sec. The phase margin of the com- 
pensated system is determined from Fig. 10-29 to be about 50°. 

The magnitude-versus-phase curves of the uncompensated and the compensated 
systems are plotted on the Nichols chart, as shown in Fig. 10-30. It is seen that the 
resonant peak, M/,, of the compensated system is approximately 1.4 dB. The bandwidth 
of the system is reduced from 70 rad/sec to 32 rad/sec. 

The unit step responses of the uncompensated and the compensated systems are 
shown in Fig. 10-31. The effects of the phase-lag controller are that the overshoot is 
reduced from 44.4 per cent to 22 per cent, but the rise time is increased considerably. 
The latter effect is apparently due to the reduction of the bandwidth by the phase-lag 
controller. Figure 10-31 also gives the step responses of the system when the value of 
T of the phase-lag controller is changed to 5 and then to 10. It is seen that larger values 
of 7 give only slight improvements on the overshoot of the step response. Earlier it was 
pointed out that the value of 7 is not critical; when T = 5, it is equivalent to setting 
1/aT at 20 times below the gain-crossover frequency of @, = 20 rad/sec. Similarly, 
T = 10 corresponds to placing 1/aT at 40 times below a}. 


Phase-Lag Compensation by the Root Locus Method 


The design of phase-lag compensation is best illustrated by the root locus 
diagram of the system considered in Example 10-3, which is shown in Fig. 10-32. 
In this figure the root loci of the uncompensated system and the compensated 
system are shown. It is important to note that since the simple pole and zero of 
the phase-lag controller are placed close together and are very near the origin, 
they have very little effect on the shape of the original root loci, especially near 
the region where the eigenvalues should be located to achieve the desired per- 
formance. However, the values of K that correspond to similar points on the 
two root loci are different. For example, when K = 1, which gives the desired 
steady-state response, the eigenvalues of the uncompensated system are 5 = 
—12.5 + j48.4 and s = —12.5 — j48.4, which correspond to a damping ratio 
of 25 per cent. The comparable points to these eigenvalues on the compensated 
root loci correspond to K = 5, which is 5 times greater. In fact, when K = 1 
on the root loci of the compensated system, the eigenvalues are at s = —11.6 + 
J18 and s = —11.6 — j18, which correspond to a damping ratio (for these com- 
plex roots) of 56.2 per cent. 
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Fig. 10-30. Plots of G(s) in Nichols chart for the system in Example 10-3. 
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Fig. 10-31. Step responses of the sun-seeker system in Example 10-3. 


It is simple to show that the values of K on the root loci of the compensated 
system at points relatively far away from the origin are 5 times greater than those 
values of K at similar points on the root loci of the uncompensated system. For 
instance, at the root s = —11.6 + j18 on the compensated root loci of Fig. 
10-32, the value of K is 1; the comparable point on the uncompensated root loci 
iss = —12.5 + 718.4, and the value of K at that point is 0.2. The Bode diagram 
result of Fig. 10-29 already reflects this relation on the values of K, since the 
phase-lag network hardly altered the phase plot near the gain-crossover fre- 
quency, but reduced the gain by 14 dB, which is a factor of 5. Another explana- 
tion of the relation between the values of K of the uncompensated loci and those 
of the compensated may be obtained by referring to the open-loop transfer 
functions of the two systems. From Eq. (10-62), the value of K at a point s, on 
the root loci for the uncompensated system is written 

Is |] 51 + 25| 
|K| = sls 2 (10-69) 
Assuming that a point s, is on the compensated root loci and is far from the 
pole and zero of the phase-lag network at s = —0.4 and s = —2, respectively, 
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the value of K at s, is given by 
_ (sills, +0.4|[5, + 25| x 
A 0s Sar (10-70) 
or 
~ {Si {ls; +25] 
[KIS 500 


since the distance from s, to —0.4 will be approximately the same as that from 
gs, to —2. This argument also points to the fact that the exact location of the pole 
and the zero of the phase-lag network is not significant as long as they are close 
to the origin, and that the distance between the pole and the zero is a fixed 
desired quantity. In the case of the last example, the ratio between 1/aT and 1/T 
is 5. 

Based on the discussions given above, we may outline a root locus design 
procedure for the phase-lag design of control systems as follows: 

Since the design will be carried out in the s-plane, the specifications on the 
transient response or the relative stability should be given in terms of the damp- 
ing ratio of the dominant roots, and other quantities such as rise time, band- 
width, and maximum overshoot, which can be correlated with the location of 
the eigenvalues. 


s-plane 


(a) 


Fig. 10-32. (a) Root loci of G(s) = 2500K/[s(s + 25)] of the sun-seeker 
system. 
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s-plane 


(b) 


Fig. 10-32 (Cont.). (b) Root loci of G(s) = 500(s + 2)/[s(s + 25)(s + 0.4)] 
of the sun-seeker system. 


1. 


2. 


Sketch the root loci of the characteristic equation of the uncompen- 
sated system. 

Determine on these root loci where the desired eigenvalues should be 
located to achieve the desired relative stability of the system. Find 
the value of K that corresponds to these eigenvalues. 


. Compare the value of K required for steady-state performance and 


the K found in the last step. The ratio of these two Ks is a (a < 1), 
which is the desired ratio between the pole and the zero of the phase- 
lag controller. 


. The exact value of 7 is not critical as long as it is relatively large. 


We may choose the value of 1/aT to be many orders of magnitudes 
smaller than the smallest pole of the process transfer function. 


Let us repeat the design of the system in Example 10-3 by means of the 
root locus method just outlined. Instead of using the phase-margin specification, 
we require that the damping ratio of the dominant eigenvalues of the closed- 
loop system be approximately 56.2 per cent. This value of the damping ratio is 
chosen so that we can compare the result of the root locus design with that 
which was obtained independently by the Bode diagram method. The root locus 
diagram of the original uncompensated system is drawn as shown in Fig. 
10-32(a), based on the pole—-zero configuration of Eq. (10-62). The steady-state 
performance specification requires that the value of K should be equal to 1 or 
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greater. From the root loci of Fig. 10-32(a), it is found that a damping ratio of 
56.2 per cent may be attained by setting K of the original system equal to 0.2. 
Therefore, the ratio of the two values of K is 
2302 +a 
a en) 
The desired relative stability is attained by setting K to 0.2 in the open-loop 
transfer function of Eq. (10-62) to give 


6.(s) 500 


” (10-71) 


a(s) ~ ss + 25) (10-72) 
The open-loop transfer function of the compensated system is given by 
6,(s) _ 2500K(1 + aTs) 
a(s)  s(s + 25)(h + Ts) (10-73) 


_ 2500aK(s + 1/aT) 
~~ s(s + 25)(s + I/T) 


If the values of aT and T are chosen to be large, Eq. (10-73) is approximately 


6,(s) — 2500aK 

a(s) — s(s + 25) 
from the transient standpoint. Since K is necessarily equal to unity, to have the 
right sides of Eqs. (10-72) and (10-74) equal to each other, a = 1/5, as is already 
determined in Eq. (10-71). Theoretically, the value of T can be arbitrarily large. 
However, in order that the bandwidth of the closed-loop system is not too small, 
we must not make T too large. By setting T = 2.5, the root loci of the compen- 
sated system will be identical to that of Fig. 10-32(b). 

As an alternative, the root locus design can also be carried out by means 
of the root contour method. The root contour method was applied to the sun- 
seeker system earlier in the phase-lead design. The design carried out by Eqs. 
(10-38) through (10-43) and Figs. 10-20 and 10-21 is still valid for phase-lag 
control, except that in the present case a < 1. Thus in Fig. 10-21 only the por- 
tions of the root contours that correspond to a < 1 are applicable for phase-lag 
compensation. These root contours show that for effective phase-lag control, 
the value of T should be relatively large. In Fig. 10-33 we illustrate further that 
the complex eigenvalues of the closed-loop system are rather insensitive to the 
value of T when the latter is relatively large. 


(10-74) 


ExampLe 10-4 Consider the system given in Example 10-2 for which the phase-lead 
compensation is ineffective. The open-loop transfer function of the 
original system and the performance specifications are repeated as 

follows: 


K 
G8) = TOs + 0.38) 10-75) 
The performance specifications are 


1. K, = 100 sec™!. 
2. Phase margin > 40°. 
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Fig. 10-33. Root contours of s(s + 25)(1 + Ts) + 2500K(i + aTs) = 0; 
K=1., 


The phase-lag design procedure is as follows: 


1. The Bode plot of G,(s) is made as shown in Fig. 10-34 for K = 100. 

2. The phase margin at the gain-crossover frequency, @, = 17 rad/sec, is 
approximately —45°, and the closed-loop system is unstable. 

3. The desired phase margin is 40°; and from Fig. 10-34 this can be realized 
if the gain-crossover frequency is moved to approximately 4 rad/sec. This 
means that the phase-lag controller must reduce the magnitude of G,(j@) 
to 0 dB, while it does not affect the phase curve at this new gain crossover 
frequency, @%. Since actually a small negative phase is still introduced by 
the phase-lag controller at 2, it is a safe measure to choose the new gain- 
crossover frequency somewhat less then 4 rad/sec, say at 3.5 rad/sec. As an 
alternative, we may select a larger phase margin of 45°. 

4. From the Bode plot, the magnitude of G,(j@) at @{, = 3.5 rad/sec is 30 dB, 
which means that the controller must introduce 30 dB of attenuation at 
this frequency, in order to bring down the magnitude curve of G,(j@) to 
0 dB. Thus, from Eq. (10-59), 


a = 1907 1Grliae1/20 — 19-1-5 — 0,032 (10-76) 


This equation implies that the two corners of the phase-lag controller 


548 / Introduction to Control Systems Design Chap. 10 


0.01 0.0112 


G(s) = 


—_ 1000 
sl +0.15)0 +0. 


G,(s) = 


100 (1 + 2.865) 
s(1 + 0.1s)(1 + 0.25) + 89.35) 


— 
— 


Phase margin of { 
compensated system Phase margin of 


uncompensated system 
0.1 0.35 1.0 2.5 ww, 10 100 
w rad/sec 


Fig. 10-34. Bode plots of compensated and uncompensated systems in 
Example 10-4. 


must be placed 1.5 decades apart, in order to produce the required 30 dB 
of attenuation. 

5. Using the guideline that the upper corner frequency of the controller, 
l/aT, is placed at the frequency of 1 decade below the new gain-crossover 
frequency, we have 


= a3 = 0,35 rad/sec (10-77) 


which gives 
T = 89.3 
6. The Bode plot of the compensated system, with the phase-lag controller 
transfer function given by 
1+ aTs 1 + 2.86s 
1+ 7s 1 + 89.35 
is sketched in Fig. 10-34. It is seen that the phase margin of the compen- 
sated system is approximately 40°. 
7. The open-loop transfer function of the compensated system is 


100(1 + 2.86s) 
s(t + Os) + 0.2s)(1 +. 89.35) 


G(s) = (10-78) 


G(s) = G.(s)G,(s) = (10-79) 


The magnitude-versus-phase curves of the compensated and the uncompensated 
systems are plotted on the Nichols chart, as shown in Fig. 10-35, These curves show 


Compensated system 
Uncompensated system 
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Fig. 10-35. Plots of G(s) of the compensated and the uncompensated sys- 
tems in the Nichols chart for Example 10-4. 
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that the uncompensated system is unstable, but the compensated system has the 
following performance data as measured by the frequency-domain criteria: 


resonant peak M, = 3 dB (1.41) 
phase margin = 40 deg 

gain margin = 10 dB 
bandwidth = 6 rad/sec 


When K = 100, the open-loop transfer function of the uncompensated system and 
the compensated system may be written 


5000 
GS) = G36 FIO oe 
6ie 160(s + 0.35) (10-81) 


s(s + 5)(s + 10)(s + 0.0112) 


jw 


/- 


s-plane jis 


j10 
j7.07 (K = 15) 
76.73 (K = 420) 


(K = 3.2) 
— 1.53 + 73.335 


(K = 100) ~ 1.44 +72 
K=0 


50K 
s(s + 5)(s + 10) 


2 1.6K(s + 0.35) 
OOS) = G55 + 105 + 0.0112) 


G(s) = 


Fig. 10-36. Root loci of compensated and uncompensated systems in 
Example 10-5. 
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respectively. These transfer functions give indication of the improvements made on the 
system’s performance from the root locus point of view. The gain constant of G(s) in 
Eq. (10-80) is 5000, whereas that of G(s) in Eq. (10-81) is only 160; the ratio of 160 to 
5000 is the constant, a, which is determined earlier to be 0.032. This means that since 
the pole and zero of the phase-lag controller are very close to the origin, as compared 
with the poles at s = —5 and —10, the controller effectively reduced the loop gain of 
the system by a factor of 0.032. Figure 10-36 shows the root loci of the uncompensated 
and the compensated systems. Again, the loci of the complex roots are very close to 
each other for the two cases. The critical value of K for the uncompensated system is 
15, whereas for the compensated system it is 420. When K = 100, the compensated 
system has eigenvalues at s 11.33, s = —0.8, s = —1.436 +2, and s = —1.436 
— j2. The unit step response of the system with the phase-lag controller is shown in 
Fig. 10-37. The peak overshoot of the system is approximately 35 per cent. 
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Fig. 10-37. Unit step response of the system with phase-lag compensation 
in Example 10-4. 


Effects and Limitations of Phase-Lag Compensation 


From the results of the preceding illustrative examples, the effects and limi- 
tations of phase-lag compensation on the performance of a control system may 
be summarized as follows: 


1. For a given relative stability, the velocity error constant is increased. 

2. The gain-crossover frequency is decreased; thus the bandwidth of 
the closed-loop system is decreased. 

3. For a given loop gain, K, the magnitude of the open-loop transfer 
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function is attenuated at the gain-crossover frequency, thus allowing 
improvement in the phase margin, gain margin, and resonance peak 
of the system. 

4. The rise time of the system with phase-lag compensation is usually 
slower, since the bandwidth is usually decreased. For additional 
reduction in the overshoot, the rise time is further increased. 


10.5 Lag—Lead Compensation 


We have learned from the preceding sections that phase-lead compensation 
usually improves the rise time and the overshoot but increases the bandwidth 
of a feedback control system, and it is effective for systems without too severe 
a stability problem. On the other hand, phase-lag compensation improves the 
overshoot and relative stability but often results in longer rise time because of 
reduced bandwidth. Therefore, we can say that each of these two types of con- 
trol has its advantages and disadvantages. However, there are many systems 
that cannot be satisfactorily improved by the use of either scheme. Therefore, 
it is natural to consider the use of a combination of the lead and the lag con- 
trollers, so that the advantages of both schemes may be utilized; at the same 
time, some of the undesirable features in each are eliminated in the combined 


structure. 
The transfer function of such a lag-lead (or lead-lag) controller may be 
written 
_ {i+ aT,s\/1 4+ 67,5 . 
G49) = (FFE) (Tere) (10-82) 


| — lead > || < lag > | 


where a > 1 and b < 1, and the attenuation factor 1/a is not shown in the equa- 
tion if we assume that adequate loop gain is available in the system to compen- 
sate for this loss. 

Usually it is not necessary to cascade the lead and the lag networks of Figs. 
10-10 and 10-25 for the realization of Eq. (10-82) if a and b need not be specified 
independently. A network that has lag-lead characteristics, but with fewer num- 
ber of elements, is shown in Fig. 10-38. The transfer function of the network is 


Fig. 10-38. Lag—lead network. 
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6.) = BO = RC ERG ROR ECR (108) 
Comparing Eq. (10-82) with Eq. (10-83), we have 
aT, =R,C, (10-84) 
bT, = RC, (10-85) 
T,T, = R,R2C,C, (10-86) 
From Eqs. (10-84) and (10-85), we have 
abT ,T, = R,R.C,C, (10-87) 
Thus 
ab=1 (10-88) 


which means that a and } cannot be specified independently. 


EXAMPLE 10-5 In this example we shall design a lag—lead controller for the control 
system considered in Examples 10-2 and 10-4. The open-loop transfer 
function of the original system is repeated as 


K 
G8) = POIs) + 0.35) 


The performance specifications are 


(10-89) 


1, K, = 100 sec!. 
2. Phase margin > 40°. 


These requirements have been satisfied by the phase-lag controller designed in 
Example 10-4. However, it is noted that the phase-lag controller yielded a step response 
that has a relatively large rise time. In this example we shall design a lag-lead controller 
so that the rise time is reduced. 

Let the series controller be represented by the transfer function 


(1 + aTis). + 5725) 
(1 + Tis) + 728) 


For the first part we consider that the lag-lead controller is realized by the network of 
Fig. 10-38, so that the coefficients a and b are related through Eq. (10-88). 

In general, there is no fixed procedure available for the design of the lag—lead 
controller. Usually, a trial-and-error procedure, using the design techniques outlined 
for the phase-lag and the phase-lead controllers, may provide a satisfactory design 
arrangement. 

Let us first determine the phase-lag portion of the compensation by selecting the 
proper values of 7, and b of Eq. (10-90). The Bode plot of G,(s) of Eq. (10-89) is 
sketched in Fig. 10-39 for K = 100. We arbitrarily choose to move the gain-crossover 
frequency of G,(j@) from 17 rad/sec to 6 rad/sec. Recall that in Example 10-4, the 
desired new gain-crossover frequency is 3.5 rad/sec when phase-lag compensation 
alone is used. With the gain-crossover frequency at 6 rad/sec, the phase margin of the 
system should be improved to approximately 10°. Using the phase-lag design technique, 
we notice that the attenuation needed to bring the magnitude of G,(j@) down to 0dB 
at w!, = 6 rad/sec is —22 dB. Thus using Eq. (10-59), we have 


b = 10-27/20 = 1071-1 = 0.08 (10-91) 


GAs) = (10-90) 
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Fig. 10-39. Bode plots of uncompensated system and compensated system 
with lag-lead controller in Example 10-5. 


Placing 1/bT at 1 decade of frequency below w, = 6 rad/sec, we have 


br = s = 0.6 rad/sec (10-92) 
Thus 

T, = 20.83 (10-93) 
and 


77 0.048 (10-94) 


The phase-lag portion of the controller is described by 


1 + 1.667s 
1 + 20.835 


Now we turn to the phase-lead part of the controller. Since a is equal to the 
inverse of 6, the value of a is found to be 12.5. From Eq. (10-20), the maximum phase 
lead that corresponds to this value of a is 


, a—l 
sin bm =p 0.8518 (10-95) 
or 
bm = 58.3 deg 


The zero-frequency attenuation of the phase-lead controller is 
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20 logio a = 20 logy) 12.5 = 21.9 dB (10-96) 


Using the procedure outlined earlier, the new gain-crossover frequency is found to be 
at @,, = 11 rad/sec. Then, using Eq. (10-15), we get 


- ee oe tee (10-97) 
1 
and 

1 


af, = ott 


The transfer function of the lag-lead controller is determined as 


(1 + 0.325) + 1.6675) 
(1 + 0.0257s)(1 + 20.835) 


where as a usual practice, the attenuation factor in the phase-lead portion has been 
dropped. 
Figure 10-39 shows that the phase margin of the compensated system is approxi- 


mately 40°. The open-loop transfer function of the compensated system with K = 100 
is 


G.(s) (10-98) 


ra 2, 4981(s + 3.11)(s -+ 0.6) ; 
G(s) = GlS)G ols) = 5S TONS + 38.88) (5 F004) —s«- (1-99 


The unit step response of the compensated system is shown in Fig. 10-40. It is apparent 


1.5 


System with phase-lag 
controller 


oe 
~~ 


1.0 


System with lag-lead 
controller 


Time (seconds) 


Fig. 10-40. Unit step response of the system in Example 10-5 with lag-lead 
controller. 
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K=4981 K=0 


s-plane 


(— 4.159 + 710.556) 


Fig. 10-41. Root locus diagram of the system in Example 10-5 with lag- 
jead controller. 


that the step response of the system with the lag—lead controller is much improved 
over that of the phase-lag compensated system. Not only the overshoot is smaller, but 
the rise time is also greatly reduced. We may attribute these improvements to the 
addition of the phase-lead portion of the controller. It can be easily verified that the 
bandwidth of the closed-loop system is now approximately 18 rad/sec, which is 3 
times that of the system with the phase-lag controller alone. 

The root locus diagram of Fig. 10-41 shows that the dominant complex roots of 
the lag-lead compensated system correspond to a much larger natural undamped 
frequency than that of the system with only the phase-lag controller designed in Exam- 
ple 10-4, Fig. 10-36. This accounts for the fact that the lag—lead compensation gives a 
wider bandwidth and thus a shorter rise time. The root locus diagram of Fig. 10-41 
also shows that for all practical purposes, the transfer function of the closed-loop 
system with the lag—lead controller can be approximated by 


C(s) _ 5487 
RG) (+ 42.6275 + 4.159 + 710.5565 + 4.159 — 7 10.556) 


where the closed-loop poles at —0.616 and —2.76 are effectively canceled by the zeros 
at —0.6 and —3.11, respectively. 

It should be pointed out that we have been fortunate to have found a solution to 
the design problem on the first trial. In general, any trial-and-error design scheme may 


(10-100) 
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not be as straightforward, especially since there is a constraint between a and 6 of Eq. 
(10-90). In other words, once we selected a value for 5, @ is also determined. It is 
entirely possible that the combination does not satisfy the design specifications. 


10.6 Bridged-T Network Compensation 


Many controlled processes ‘have transfer functions that contain one or more 
pairs of complex-conjugate poles. One of the distinct features of a pair of com- 
plex poles is that the gradient of the phase with respect to frequency near the 
gain-crossover frequency is large. This is similar to the situation when two or 
more simple poles of the transfer function are placed close to each other. With 
reference to the system considered in Examples 10-2 and 10-4, the reason the 
phase-lead controller is ineffective in improving the relative stability of the sys- 
tem is because the phase of the process has a steep negative slope near the gain- 
crossover frequency (see Fig. 10-22). When a process has complex poles, especially 
if the poles are close to the imaginary axis, the design problem may become 
more acute. We may suggest the use of a controller that has a transfer function 
with zeros so selected as to cancel the undesired complex poles of the origi- 
nal process, and the poles of the controller are placed at the desired locations 
in the s-plane. For instance, if the transfer function of a process is 


G,(s) = GEST (10-101) 
in which the complex-conjugate poles are causing stability problems in the 
closed-loop system, the suggested series controller may have the transfer func- 
tion 
s?+s+10 
GAs) = RE Tay ea (10-102) 
The constants ¢ and q@, are determined according to the performance 
specifications of the system. Although the transfer function of Eq. (10-102) can 
be realized by various types of passive networks, the bridged-T networks have 
the advantage of containing only RC elements. Figure 10-42 illustrates two basic 
types of the bridged-T RC networks. In the following discussion, the network 
shown in Fig. 10-42(a) is referred to as the bridged-T type 1, and that of Fig. 
10-42(b) is referred to as type 2. 
With the assumption of zero input source impedance and infinite output 
impedance, the transfer function of the bridged-T type 1 network is given by 


Ex(s) 1 + 2RC,5 + R?C,C,s* 


E\(s) 1+ R(C, + 2C,)s -+ R°C,C,s? (10-103) 
and that of the bridged-T type 2 network is 
E,(s) _ 1 + 2R,Cs + C?R,R,s? deaesy 


E,(s) 1 +- CCR, + 2R,)s + C?R, R28? 


When these two equations are compared, it is apparent that the two net- 
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Fig. 10-42. Two basic types of bridged-T network. (a) Type | network. (b) 
Type 2 network. 


works have similar transfer characteristics. In fact, if R, C;, and C, in Eq. 
(10-103) are replaced by C, R,, and R,, respectively, Eq. (10-103) becomes the 
transfer function of the type 2 network given by Eq. (10-104). 

It is useful to study the behavior of the poles and zeros of the transfer func- 
tions of the bridged-T networks of Eqs. (10-103) and (10-104) when the net- 
work parameters are varied. Owing to the similarity of the two networks, only 
type 1 will be studied here. 

Equation (10-103) is written as 


2 1 
2 —_—— > 
E(s) © TRES+ ROG 
E,(s)” og | C, + 2C, 1 
oT REC, °* ROG 
If both the numerator and the denominator polynomials of Eq. (10-105) are 
written in the standard form 


Ss? + 2,5 + @2 = 0 (10-106) 
we have, for the numerator, 


(10-105) 


I 
= fe 
On = RIC LG 


= /¢ 10-10 
= /& (10-108) 


(10-107) 
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and for the denominator, 


1 
= eS 10-109 
Op = te TEC, = Ons ( ) 
—~ Oi +2C, _ 1+ 20,/C, _ 1+ 26? 10-110 
oe = 2xi C Gs 2,/C,/C; ae; ‘ ; 


The loci of the poles and zeros of E,(s)/E,(s) of Eq. (10-105) when C,, C,, 
and R vary individually are sketched in Fig. 10-43. When R varies, the numerator 
and the denominator of Eq. (10-105) contain R in the form of R*, and the root 
locus method cannot be applied directly to this nonlinear problem. Fortunately, 


= Root locus of zeros Root locus of poles 


0<C, C\ 70 Cc, =0 C, 7% 


s-plane 
2 
RC, 


sa 
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in this case, the equations that are of the form of Eq. (10-106) are of the second 
order and can be solved easily. Therefore, the pole and zero loci of Fig. 10-43 
show that the two zeros of the bridged-T network type | can be either real or 
complex; for complex zeros, C, must be less than C,. The poles of the transfer 
function always lie on the negative real axis. 

The ¢ and w, parameters of the denominator and the numerator of the 
transfer function of the type 2 network may be obtained by replacing R, C,, and 
C, in Eqs. (10-107) through (10-110) by C, R,, and R,, respectively. Thus 


l 


One = LET ( 1) 
oe Ry ae) 

Ce R, (10-112) 
np = Daz (10-113) 
—_ R2 + 2R, 10-1 
op TRE, (10-114) 


The root loci shown in Fig. 10-43 can still be used for the type 2 bridged-T 
network if the corresponding symbols are altered. 


EXAMPLE 10-6 The control system shown in Fig. 10-44 is selected to demonstrate 
the use of the bridged-T network as a controller and the principle of 
improving system performance by pole~zero cancellation. 


K(1 + 10s) Cs) 
s(1 + 0.25 + 0.2552) 


Controller 


Fig. 10-44. Feedback control system for Example 10-6. 


The controlled process has the transfer function 


K(1 + 10s) 


CAS) = 02s + 0.2558) 


(10-115) 
The root locus diagram of the uncompensated closed-loop system is shown in Fig. 
10-45, It is shown that although the closed-loop system is always stable, the damping 
of the system is very low, and the step response of the system will be quite oscillatory 
for any positive K. Figure 10-47 illustrates the unit step response of the system when 
K = 1, Notice that the zero at s = —0.1 of the open-loop transfer function causes the 
closed-loop system to have an eigenvalue at s = —-0.091, which corresponds to a time 
constant of 11 sec. Thus this small eigenvalue causes the step response of Fig. 10-47 to 
oscillate about a level that is below unity, and it would take a long time for the response 
to reach the desired steady state. 
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Let us select the type 1 bridged-T network as series com- 


ft pensation to improve the relative stability of the system. The 
K complex-conjugate zeros of the network should be so placed 
K=1 4 — 0.354 + j6.62 that they will cancel the undesirable poles of the controlled 
process. Therefore, the transfer function of the bridged-T net- 
work should be 
s-plane is s? + 0.85 4-4 
= + > FS 10-116 
G.(s) 7 GA + OL, (10-116) 
Using Eqs. (10-107) and (10-108), we have 
. 2 : 10-117 
Onz= = R/C, C2 ( es ) 
K=0 — 0.4 +71.96 a 
2=,/—2 = 0.2 10-118 
4 C, ¢ ) 
re From Eqs. (10-109) and (10-110), 
Onp = Dar = 2 (10-119) 
One root at 
— 0.093 (K = 1) aud 4 gps 
K=0%-1-04 -/1.96 oo = F227 (10-120) 
—73 The transfer function of the type 1 bridged-T network is 
s? +0.85 + 4 
GAS) = GF O384s + 104D (10-121) 
~j5 The open-loop transfer function of the compensated system is 
=< = 40K(s + 0.1) ‘ 
Pay | eeraeoee O18) = CNG) = SEF O5RaNE + TOAD (10-122) 


Fig. 10-45. Root loci of the feedback control 
system in Example 10-6 with G,(s) = 


[K(1 + 10s)]/{s(l + 0.25 + 0.2552)]. 


The root loci of the compensated system are sketched as 
shown in Fig. 10-46. The root loci show that for K greater 
than 0.64, two of the eigenvalues of the system are complex. 
However, the dynamic response of the system is still domi- 
nated by the eigenvalue that lies near the origin of the s-plane. 
Figure 10-47 illustrates the unit step response of the compen- 
sated system when K = ]. In this case the complex eigenvalues 


of the compensated system cause the response to oscillate only slightly, but the eigen- 
value at s = —0.093 causes the system response to take a very long time in reaching 
its steady state of unity. It is apparent that the relative stability of the system is greatly 
improved by the bridged-T controller through pole-zero cancellation. 


Although the preceding design is carried out on the basis that the undesir- 
able poles of the controlled process are exactly canceled by the zeros of the con- 
troller, in practice this ideal situation is difficult to achieve. One of the difficulties 
lies in the fact that we cannot design the controller so that its poles and zeros 
will fall exactly at the specified locations. Another problem is lack of knowledge 
as to exactly where the poles of the process are. Usually, in the determination of 
the transfer function of a process, assumptions and approximations have to be 
made, so that the mathematical description of the system is never precise. In 
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— 0.093 when K = | 


K=1 7 — 5.33 —j3.8 


Fig. 10-46. Root loci of feedback control system in Example 10-6 with 
bridged-T controller. 


view of these practical considerations, in practice, a more realistic situation in 
the attempt of the pole-zero cancellation design is at best a “near cancellation.” 
Let us consider that the design of the bridged-T compensation of the system 
in Example 10-6 resulted in an inexact pole-zero cancellation, so that the trans- 
fer function of the controller is 
__ s* + 0.765 4+- 3.8 : 
GCS) = G0.366\8 + 10.4) Ceri23) 
Since the complex poles of the controlled process are not canceled by the zeros 
of G(s), the open-loop transfer function of the system becomes 


40K(s + 0.1)(s? + 0.765 + 3.8) _ (10-124) 
3(s + 0.366)(s + 10.4\(s? + 0.85 + 4) 


For all practical purposes, the complex poles and zeros of G(s) of Eq. (10-124) 
can still be considered as close enough for cancellation. For K = 1, the closed- 
loop transfer function is 


G(s) = 
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Uncompensated system 


c(t) 


Seconds 


Fig. 10-47. Unit step responses of the compensated and the uncompen- 
sated systems in Example 10-6. 


C(s) 40(s + 0.1)(s? + 0.768 + 3.8) (10-125) 

R(s) (s + 0.093)(s? + 0.815 + 3.805)(s? + 10.665 + 42.88) 
Since the zeros of the open-loop transfer function are retained as zeros of the 
closed-loop transfer function, Eq. (10-125) verifies that near cancellation of 
poles and zeros in the open-loop transfer function will result in the same situa- 
tion for the closed-loop transfer function. Therefore, we may conclude that from 
the transient response standpoint, the effectiveness of the cancellation com- 
pensation is not diminished even if the pole-zero cancellation is not exact. 
Alternatively, we can show that if the partial-fraction expansion of Eq. (10-125) 
is carried out, the coefficients that correspond to the roots of s? + 0.815 + 
3.805 = 0 will be very small, so that the contribution to the time response from 
these roots will be negligible. 

If the undesirable poles of the open-loop transfer function are very close to 
or right on the imaginary axis of the s-plane, inexact cancellation may result in a 
conditionally stable or an unstable system. Figure 10-48(a) illustrates a situation 
in which the relative positions of the poles and zeros intended for cancellation 
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s-plane K=0 


Fig. 10-48. Root locus diagrams showing the effects of inexact pole-zero 
cancellations. 


result in a stable system, whereas in Fig. 10-48(b), the inexact cancellation is 
unacceptable, although the relative distance between the poles and zeros 
intended for cancellation is small. Normally, the two situations may be dis- 
tinguished simply by the use of the angles of departure properties of the root loci. 
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PROBLEMS 


10.1. The open-loop transfer function of a feedback control system is given by 


ae Sree 
sl + 0.2) + 0.55) 


The feedback is unity. The output of the system is to follow a reference ramp 

input to yield a velocity of 2 rpm with a maximum steady-state error of 2°. 

(a) Determine the smallest value of K that will satisfy the specification given 
above. With this value of K, analyze the system performance by evaluating 
the system gain margin, phase margin, 4/,, and bandwidth. 

(b) A lead compensation with the transfer function (1 + 0.4s)(1 + 0.08s) is 
inserted in the forward path of the system. Evaluate the values of the gain 
margin, phase margin, M,, and bandwidth of the compensated system. 
Comment on the effects of the lead compensation of the system perfor- 
mance. 

(c) Sketch the root loci of the compensated and the uncompensated systems. 


10.2. A type-2 control system is shown in Fig. P10-2. The system must meet the 
following performance specifications: 
(a) Acceleration constant K, = 5 sec™?. 


(b) The resonance peak M, < 1.5. 
ae ee 
s2(1+0.15) 


G(s) = 


CG) 


Figure P10-2. 


Design a series phase-lead controller to satisfy these requirements. Sketch the 
root loci for the uncompensated and compensated systems. What are the values 
of the damping ratio (of the complex roots) and the bandwidth of the compen- 
sated system ? 

10.3. Figure P10-3 illustrates the block diagram of a positioning control system. 
The system may be used for the positioning of a shaft by a command from a 
remote location. The parameters of the system are given as follows: 


Tt. = 0.01 sec 


J = 0.05 oz-in-sec? 
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10.4. 


10.5. 


Motor Ty, 
electric Motor and 
circuit load 


Controller 


Figure P10-3. 


B=0.5 oz-in-sec 
K, = 10 oz-in/volt 
T, = disturbance torque 


(a) Determine the minimum value of the error sensor and amplifier gain K, so 
that the steady-state error of 9) due to a unit step torque disturbance is 
less than or equal to 0.01 (1 per cent). 

(b) Determine the stability of the system when K, is set at the value deter- 
mined in part (a). 

Design a phase-lead controller in the form 


1 + aTs 
1 + Ts 


so that the closed-loop system has a phase margin of approximately 40°. 
Determine the bandwidth of the compensated system. Plot the output 
response @,(t) when the input @,(¢) is a unit step function. (T, = 0.) 


Repeat the design problem in Problem 10-3 with a phase-lag controller 


1 + aTs 
1+ 7s 


Human beings breathe in order to provide the means for gas exchange for the 
entire body. A respiratory control system is needed to ensure that the body’s 
needs for this gas exchange are adequately met. The criterion of control is 
adequate ventilation, which ensures satisfactory levels of both oxygen and 
carbon dioxide in the arterial blood. Respiration is controlled by neural 
impulses that originate within the lower brain and are transmitted to the chest 
cavity and diaphragm to govern the rate and tidal volume. One source of the 
signals is the chemoreceptors located near the respiratory center, which are 
sensitive to carbon dioxide and oxygen concentrations. Figure P10-5 shows the 
block diagram of a simplified model of the human respiratory control system. 
The objective is to control the effective ventilation of the lungs so that satis- 
factory balance of concentrations of carbon dioxide and oxygen is maintained 
in the blood circulated at the chemoreceptor. 
(a) A normal value of the chemoreceptor gain Ky is 0.1. Determine the gain 
margin and the phase margin of the system. 
(b) Assume that the chemoreceptor is defective so that its gain K 'y is increased 
to 1. Design a controller in the forward path (to be inserted in front of the 
block representing the lungs) so that a phase margin of 45° is. maintained. 


G(s) = a>l 


G,(s) = a<l 
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Figure P10-5. 


10.6. This problem deals with the cable-reel unwind process described in Problem 
5-16 and shown in Fig. P5-16. The inertia of the reel is 


Jr = 18R* — 200 ft-lb-sec? 


where R is the effective radius of the cable reel. 

(a) Assume that R and Jz are constant between layers of the cable. Determine 
the maximum value of the amplifier gain K so that the entire unwinding 
process is stable from beginning until end. 

(b) Let K = 10. Design a series controller so that the system has a phase 
margin of 45° at the end of the unwind process (R = 2 ft). With this 
controller, what are the phase and gain margins of the system at the begin- 
ning of the unwind process? Sketch the root loci of the compensated 
process with K = 10 and indicate the variation of the roots on the loci as 
the unwind process progresses. It should be noted that the treatment of 
this problem by a transfer function is only an approximation; strictly, the 
process is nonlinear as well as time varying. 


10.7. Figure P10-7 shows the block diagram of the speed control system for an 
electrical power generating system. The speed governor valve controls the 
steam flow input to the turbine. The turbine drives the generator, which puts 
out electric power at a frequency proportional to the generator speed @,. The 


7, 

Speed L 

governor Steam Power system 
valve turbine generator 


Valve 
position 


Reference 
input 
voltage 


Tachometer 


Figure P10-7, 
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10.8. 


Reference 
speed 


Phase 
detector 


desired steady-state speed of the generator is 1200 rpm, at which the generated 

output voltage is 60 Hz. J = 100. 

(a) Let the speed governor valve gain K be set at 10 rad/volt. Determine the 
tachometer gain so that the complex eigenvalues of the closed-loop system 
correspond to a damping ratio of 0.707. Sketch the root loci as a function 
of Ky and indicate the location of the roots with the desired damping. 

(b) Determine the desired reference input voltage, with the value of Ky set at 
the value determined in (a), so that the generator speed is 1200 rpm 
(Tr = 0). 

(c) In Fig. P10-7, 7; denotes a load change. Determine the per cent change in 
the steady-state speed due to a constant load change when Kr is as deter- 
mined in (a). 

(d) It is desired to keep the frequency variation due to load change within 
+0.1 per cent. At the same time, the relative damping of the complex 
eigenvalues of the overall system must be approximately 0.707. Can both 
requirements be satisfied by only changing the values of K and Kr? If not, 
design a series controller in the forward path for this purpose. Sketch the 
root locus for the compensated system with K = 10, with Kr as the 
variable parameter. 


The phase-lock loop technique is a popular method for de motor speed control. 
A basic phase-lock loop motor speed control system is shown in Fig. P10-8. 


Motor 
speed 


Motor 
control 
circuit 


Wm 


Ry Cc 
aly] 
Ein E, 
= ater 

Figure P10-8. 


The encoder produces digital pulses that represent motor speed. The pulse 
train from the encoder is compared with the reference frequency by a phase 
comparator or detector. The output of the phase detector is a voltage that is 
proportional to the phase difference between the reference speed and the 
actual motor speed. This error voltage upon filtering is used as the control 
signal for the motor. The system parameters and transfer functions are as 
follows: 
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Phase detector K, = 0.0609 volt/rad 
Motor control circuit gain K,= 
Motor transfer function Om(S) ee Ree. (Kn = 10, Ti, = 0.04) 
VAS) s(1 + T,,8) “°™ ie 
Encoder gain K. = 5,73 pulses/rad 
Filter transfer function Fa ses tt 
in 10S 
R, = 1.745 x 106Q, Cy = 1 WE 


Counter y = 1 


Determine the value of R, so that the complex roots of the closed-loop system 
have a damping ratio of approximately 0.707. If the problem has more than 
one solution, use the one that corresponds to the smallest system bandwidth. 
Sketch the root locus diagram for the characteristic equation roots as R, 
varies, 

10.9. Tachometer feedback is employed frequently in feedback control systems for 
the purpose of stabilization. Figure P10-9 shows the block diagram of a system 
with tachometer feedback. Choose the tachometer gain constant K, so that the 
relative damping ratio of the system is 50 per cent. How does the tachometer 
feedback affect the bandwidth of the system? 


Tachometer 


Figure P10-9. 


10.10. The block diagram of a control system is shown in Fig. P10-10. By means of 
the root contour method, show the effect of variation in the value of T on the 
location of the closed-loop poles of the system. 


10 


s(1 + 0.15)2 


Figure P10-10. 
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10.11. A computer-tape-drive system utilizing a permanent-magnet dc motor is 
shown in Fig, P10-11(a). The system is modeled by the diagram shown in Fig. 
P10-11(b). The constant K, represents the spring constant of the elastic tape, 
and B, denotes the viscous frictional coefficient between the tape and the 
capstans. The system parameters are as follows: 


R= 36 oz-in/volt Jim = 9.023 oz-in-sec? 


K, = 6.92 oz-in/rad/sec  K, = 2857.6 oz-in/rad 

B, = 10 oz-in-sec J, = 7.24 oz-in-sec? 
where K, = back emf constant, K, = K,K,/R. + B,,, K, = torque constant 
in oz-in/amp, and B,, = motor viscous friction constant. 
(a) Write the state equations of the system shown in Fig. P10-11(b) with 6;, 


@,,9,, and @, as the state variables in the prescribed order. Derive the 
transfer functions 


(a) 


Speed 
transducer 


(c) 


Figure P10-11. 
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O,AS @,(s) 
mo and BS 
(b) The objective of the system is to control the speed of the load, @ ,, accu- 
rately. Figure P10-11(c) shows a closed-loop system in which the load 
speed is fed back through a speed transducer and compared with the 
reference input, with K; = 0.01. Design a controller and select the ampli- 
fier gain so that the following specifications are satisfied : (1) no steady-state 
speed error when the input e, is a step function; (2) the dominant roots of 
the characteristic equation correspond to a damping ratio of approxi- 
mately 0.707; and (3) what should be the value of the input e, if the steady- 
state speed is to be 100 rpm? Sketch the root loci of the designed system 
with K as the variable parameter. 
10.12. The computer-tape-drive system described in Problem 10-11 has the following 
system parameters: 


i = 36 oz-in/volt Jm == 0.023 oz-in-sec? 
k, = "eK +p, = 6.92 oz-injradjsec  B, = 0 
K;, = 28,576 oz-in/rad K; = 0.01 


J, = 7.24 oz-in-sec? 


(a) Show that the closed-loop system without compensation has an oscillatory 
response in @, for any positive K. 

(b) In order to reduce the speed oscillations, a bridged-T network is proposed 
to cancel the undesirable poles of the open-loop transfer function. Figure 
P10-12 shows the block diagram of the overall system. Thé phase-lag 
controller preceding the bridged-T controller is for the purpose of ensuring 
zero steady-state speed error when a step input is applied. Determine the 
transfer function of the bridged-T network and the amplifier gain so that 
the dominant roots of the characteristic equation correspond to a damping 
ratio of approximately 70.7 per cent. 


Phase-lag 
Amplifier network R 


Bridged-T oe) | 
network (?] L 


Speed 
transducer 


Figure P10-12. 


11 


Introduction to Optimal 


11.1 


Control 


Introduction 


From the discussions given in Chapter 10 we realize that the conventional design 
of feedback control systems has many limitations. The most important disad- 
vantage of the conventional design approach is that these methods are not 
rigorous and rely heavily on trial and error. For a system with multiple inputs 
and outputs and a high degree of complexity, the trial-and-error approach may 
not lead to a satisfactory design. 

The optimal control design is aimed at obtaining a system that is the best 
possible with respect to a certain performance index or design criterion. The 
state-variable formulation is often used for the representation of the dynamic 
process. Since the optimal control problem is more of a mathematical develop- 
ment, the problem is stated as: 

Find the control u(t) that minimizes the performance index, 


J =f" F[x@), we), #1) dt (11-1) 


given the initial state x(t.) = X and subject to the constraint that the process is 
described by 


(1) = f[x(2), u(2), 4] (11-2) 


The performance index is a scalar quantity that consists of an integral of 
a scalar function of the state vector and the control vector. Notice that the 
state equations which describe the dynamics of the system to be controlled are 
interpreted as constraints to the design problem. In general, additional con- 
straints on the state variables and/or the control are often used. 
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In the optimal control design, the performance index J replaces the conven- 
tional design criteria such as peak overshoot, damping ratio, gain margin, and 
phase margin. Of course, the designer must be able to select the performance 
index properly so that the resulting system from the design will perform satis- 
factorily according to physical standards which are more easily interpreted by 
conventional performance criteria. 

It must be noted that the control u(t) is usually not what has been referred 
to as the reference input in conventional design terminology. Since the state 
equation of Eq. (11-2) describes the controlled process only, the statement of the 
optimal control problem may give one the misconception that the problem deals 
with the design of an open-loop system. However, when the design is accom- 
plished, usually, the optimal control will be of such a nature that it depends on 
the output or the state variables, so that a closed-loop control system is naturally 
formed. 

To illustrate the various possible formulations of the performance index J, 
the following examples are given. 


Minimum-Time Problem 


One of the most frequently encountered problems in optimal control is the 
design of a system that will be able to drive its states from some initial condition 
to the final state in minimum time. In terms of the performance index of Eq. 
(11-1), the minimum-time problem may be stated so as to minimize 


JZ = [ae (11-3) 
Thus, in Eq. (11-1), F[x@, u(a), 4] = 1. 


Linear Regulator Problem 


Given a linear system, the design objective may be to keep the states at the 
equilibrium state, and the system should be able to return to the equilibrium 
state from any initial state. The performance index for the linear regulator 
problem is 


J=4 ” x’'Qx dt , (11-4) 
where Q is a symmetric positive-definite matrix. Or, 
s=4/ "Tx'Qx -+ u’Ral dt (11-5) 


where a constraint is placed on the control vector u. The matrices Q and R are 
called the weighting matrices, as their components put various weights on the 
elements of x and u in the optimization process. 


Tracking Problem 


If it is desired that the state x of a given system track, or be as close as possible 
to a certain target trajectory x,, the problem may be formulated by minimizing 


eal (x — x,)’Q(x — x,) dt (11-6) 
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In addition to these examples, there are the minimum-energy criterion, 
minimum-fuel criterion, and many others. 


11.2 Analytical Design’: 2 


One of the first design methods that eliminates the trial-and-error uncertainties 
is analytical design, sometimes known as minimum integral-square-error design. 
The design is significant in that it forms a bridge between the conventional 
design philosophy and the modern optimal control principle. For the first time, 
the designer can simply set up the performance index and then carry out the 
complete design in a mathematical and analytical way. The only problems the 
designer has to be concerned with are: (1) if the design has a solution, and (2) if 
the solution can be physically implemented. The similarity of analytical design 
to the conventional approach is that the design is carried out in the frequency 
domain or, more appropriately stated, the s-domain. However, none of the 
frequency-domain graphical techniques is necessary. 

We first begin with the system configuration of Fig. 11-1. The assumptions 
are that the system is linear, time invariant, and that there is only one input and 
one output. Systems with multivariables may be designed by the analytical 
method, but the procedure is much more involved. Therefore, in the current 
discussion we are restricted to single-variable systems. 


Linear Linear 
controller process G(s) 


c(t) 


Fig. 11-1. Block diagram of a linear system with a controller. 


The linear controlled process of the system in Fig. 11-1 is described by the 
transfer function G(s). The control signal is u(t), and the output is c(t). Notice 
that the block diagram of Fig. 11-1 is not an algebraic one in that the controller 
is portrayed in such a way that its specific input-output configuration is not yet 
defined. This allows the flexibility of selecting the final controller configuration, 
such as a series controller or a feedback controller, once the design is completed. 

The performance index J is composed of the following two integrals: 


ie Af ‘ e2(t) dt (11-7) 
i= : u2(t) dt (11-8) 


where e(¢) is the error signal and u(t) is the control signal. J, is referred to as the 
integral square error (ISE) and J, is the integral square control (ISC). 
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The significance of using J, is that this performance index gives a flexible 
restriction on such criteria as peak overshoot, rise time, and relative stability. If 
the error between the output and the reference input is large, the value of J, will 
be large. The ISC index J, may be regarded as a measure of the energy required 
by the control. Since u2(t) is proportional to the power consumed for control, 
the time integral of u2(t) is a measure of the energy consumed by the system. 
Ordinarily, the analytical design problem may be formulated as one that desires 
the minimization of J, while keeping J, within a certain limit, or minimizing J, 
while keeping J, not greater than a certain value. Using the calculus-of-variation 
method, the problem of minimizing one function while constraining another 
function to a constant value can be solved by adjoining the constraint to 
the function to be minimized (see Appendix C). For instance, if the optimiz- 
ation problem is: 

minimize J, 
and 
J, = K = constant 


the problem is equivalent to 
minimize J = J, + k4J, (11-9) 


where k? is a parameter yet to be determined and is called the Lagrange multiplier. 
On the other hand, if we wish to 


minimize J, 
and 
J, = K = constant 
then the problem is equivalent to minimizing 
J=J,+kJ, (11-10) 


The major development of the analytical design is the use of an equivalent 
frequency-domain expression for Eq. (11-9) or Eq. (11-10) in terms of the system 
transfer function through the use of Parseval’s theorem. The version of the 
Parseval’s theorem that is applied to the present problem is 


[ eoa- |. E(s)E(—s) ds (11-11) 


where E(s) is the Laplace transform of e(t). 
Let us formulate the problem as being that of finding the optimal control 
for the system of Fig. 11-1 so that 


J=i,43,= f “[e2(t) + k2u2(t)] dt (11-12) 
0 
is minimized. 
Applying Parseval’s theorem to Eq. (11-12), we have 


a a - [E(s)E(—s) + k*U(s)U(—s)] ds (11-13) 
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With reference to Fig. 11-1, 


E(s) = R(s) — G(s)U(s) (11-14) 
Substituting Eq. (11-14) into Eq. (11-13), we get 
r= [7 [R) — GQUEOMR-9) — G5) U(-s)las 
JJ -Joo 


“nae (11-15) 
+ nj fies U(s)U(—s) ds 


Let U,,(s) be the optimal control, subject to the determination of k?. We 
can write any arbitrary U(s) as 


U(s) = U,,(s) + AU {(s) (11-16) 


where / is a constant and U,(s) is any arbitrary function that has only poles in 
the left half of the s-plane. The last condition is due to the requirement that u(r) 
must be bounded. Substitution of Eq. (11-16) into Eq. (11-15) yields 


fa) 2A A 4, (11-17) 
where 
joo = Cae as! ie = a 
foe 5 (RR — RGU, — RGU, + KUT, + GGU,,0,,) ds (11-18) 
-jo 
joo bs a3 nee 
I=x| (0, —GR+ 6G0,,)U, as (11-19) 
20] J — joo 
Joo = = is 
Je=nL | (Uy — GR + GGU,,), ds (11-20) 
2K J — joo 
22, ul “ 2 G)U.U - 
i= a). (k? + GG)U,0, ds (11-21) 


For simplicity, we have used G for G(s), U,, for U,,(s), U,, for U,,(—s), and 
so on. 
In Eq. (11-17), J, is the optimum performance index, that is, the minimum 
J. Equations (11-19) and (11-20) indicate that J, = J;, since the integrand of J, 
is identical to that of J, with s replaced by —s. Also, J, is always positive, since 
its integrand is symmetrical with respect to the imaginary axis of the s-plane. 
The necessary and sufficient conditions for Jin Eq. (11-17) to bea minimum 


are 
OJ; : 
ia 0 (11-22) 
and 
07s 
Oa |,-0 >0 (11-23) 
Applying Eq. (11-22) to Eq. (11-17) leads to 
J,+J, =2J, =90 (11-24) 


and Eq. (11-23) gives 
J,>0 (11-25) 
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which is always satisfied. Therefore, the necessary and sufficient conditions for 
minimum J are obtained from Eqs. (11-24) and (11-20), 


Jeo _ — - 
= = (K2U,, — GR + GGU,)0, ds = 0 (11-26) 


sje 

Since we have assumed that all the poles of U, are inside the left half of the 
s-plane, the poles of 7, must all lie in the right half of the s-plane. One solution 
of Eq. (11-26) is that all the poles of the integrand are in the right half of the 
s-plane, and the line integral is evaluated as a contour integral around the left 
half of the s-plane. Since the contour does not enclose any singularity of the 
integrand, the contour integration is zero. Thus J, of Eq. (11-26) is identically 
zero if all the poles of 


X(s) = GGU,, — GR+ kU, (11-27) 
are located in the right half of the s-plane. Equation (11-27) is written 
X(s) = (k? + GG)U,, — GR (11-28) 


The function (k? ++ GG) is symmetrical with respect to the imaginary axis in the 
s-plane. We let 

Y(s)¥(—s) = YY =k? + GG (11-29) 
where Y is a function that has only poles and zeros in the left half of the s-plane, 
and Y is Y with s replaced by —s and has only right-half-plane poles and zeros. 
The following notation is defined: 


Y = {k? + GG} (11-30) 

Y = {k? + GG} (11-31) 

The process of finding Y and F¥ is called spectral factorization; this is relatively 

straightforward for scalar functions but is quite complex for multivariable 
systems since matrix functions are involved. 

Equation (11-28) is now written 
X= YYU,,—GR (11-32) 
We must now separate the right side of Eq. (11-32) into two parts, one with 


poles only in the left half of the s-plane, and one with poles only in the right-half 
plane. This is accomplished by dividing both sides of the equation by Y, yielding 
- eee (11-33) 


For convenience, we assume that R has no poles in the right-half plane. 
Performing partial fraction of GR/Y in Eq. (11-33), the result is written 


GR [GR GR 
Y [ Y i as I Y il ( ; 
where _ 
[FI = expansion with poles in left-half plane (11-35) 


\F| = expansion with poles in right-half plane (11-36) 
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Then, Eq. (11-33) becomes 
X [GR GR 
a —=— = — =~ 1 a 
r+ || - 70 -[F], (137 


In this equation, the left-side terms have only poles in the right-half plane, and 
the right-side terms have only poles in the left-half plane. Therefore, the left-side 
terms must be independent of the right-side terms, or 


Un =¥ kal (11-38) 


Note that U,, is still a function of k? and it is the optimal control that minimizes 
the performance index of Eq. (11-12) for a given k?. To find the absolute 
optimum value for U,,, which is U,, we must use the constraint condition 
1 fe 
ee — =K l1- 
J, Oi | — po U(s)U(—s) ds (11-39) 
to determine k?. The integral of Eq. (11-39) may be evaluated with the aid of 
Table 11-1. 


Table 11-1. Tabulation of the Definite Integral 


Jn 


N(s) 
D(s) = 


= 


J, = 
— N3DoD1 + (N} — 2NoN2)DoD3 + NZD2D3 


= iay 
= Na-15"7! + Ny-2s"-? + 00.4 Nis + No 


1 ie N(s)N(—s) 
i - jan DOS) sy 


Djs" + Dy-1s°7-} +...+ Dis + Do 
N3 
2DoDi 
NiDo + N3D2 
2Do0D,D2 


2DoD3(—DoD3 + D1 D2) 


— N3(—D3D3 + DoD1 D2) +(N} — 2N1N3)DoD1Da + (N} — 2NoN2)DoD3Da + NA -D,D2 + D2D3D4) 


2DoD4(— DoD} — D?D4 + D1 D2D3) 


Once U,,(s) is determined, if desired, the optimal closed-loop transfer 
function can be easily determined. Let 


— Cs) : 
M,As) = RG) (11-40) 
which is the optimal closed-loop transfer function subject to finding k?. Since 
C(s) = G(s)U,,(s) (11-41) 
— Gs) , 
M,,(s) es R(s) U,,(s) dl 42) 


or 2 
My, = RY| | (11-43) 
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Equations (11-38) and (11-43) are made more useful by defining 


_ Ms) : 
where Ms) and D(s) are polynomials of s. 
Then, 
Y = {k? + GG}* 
ee [#Dp + any _ {k?DD + NN¥ (11-45) 
DD D 
and i _ 
ge OD ENN (11-46) 
D 
Equation (11-38) now gives 
igs Da aE (11-47 
{k2DD +- NN}* {k?DD + NN} 
Similarly, Eq. (11-43) leads to 
Me = i lame aw (11-48) 
R{2DD + NN} L{kK2DD + NN}. 


which is the optimal transfer function of the closed-loop system, subject to 
finding k?. 


EXAMPLE [1-1 ‘Referring to the block diagram of Fig. 11-1, consider that 


Gs) = +8 (11-49) 
and the input transform is 
R(s) = 9.3 (11-50) 


Determine the optimal control U,(s) and the optimal closed-loop transfer function 
M,(s) so that 


Wy j= f . e(t) dt = minimum (11-51) 


ae | = ua(t) dt < 2.5 (11-52) 
Since N = 10 and D = s?, we have 

{k2DD + NN}* = {k2s4 + 100}+ (11-53) 
To carry out the spectral factorization of the last equation, we write 


k2s4 + 100 = (a.s* + ays + ao)(a2s? — ays + ap) (11-54) 
= ajs* — (af — 2aza9)s? + a} 
Equating like coefficients on both sides of Eq. (11-54), 


aj = k? (11-55) 
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or 
ne (11-56) 
— 2a,a, = 0 (11-57) 
= 100 (11-58) 
which gives 
a = 10 (11-59) 
Substituting the results of a) and az into Eq. (11-57), we get 
= /20k (11-60) 
Therefore, a f 
{k2DD + NN}* = (a,57 + ays + ao) 
mie (11-61) 
= ks? + ./20ks + 10 
and . _ 
{k2DD + NN}- = ks* — /20ks + 10 (11-62) 
The second term on the right side of Eq. (11-47) is 
[ ] a | 10(0.5/s) 51 
keDD+NN}-|. (ks? —/20ks + 10 
{ + y+ p 5 /20ks + + (11-63) 


AY 
where we have considered that the pole at the origin is slightly over in the left-half 
plane. Equation (11-47) now gives 
U4. = it LSE LO sae ae GT (11-64) 


Substituting U,, into Eq. (11-39) for U, we have 


1 { 0.5s —0.55 


Je ay | ks? + </B0ks + 10 ks? —a/20ks + 10 


ds (11-65) 


This integral is evaluated by use of the formula in Table 11-1. From Table 11-1, 
_ NiD) + NiD2 


J, = 3D.D,D; (11-66) 
where N, = 0.5, No = 0, Do = 10, D; = /20k, Dz = k. Thus 
_ 0125 _ 
f= kJ 20k = 2.5 (11-67) 
from which 
k = 0.05 
The optimal control is given by 
0.5. 
Vols) = Dost Es FTO ares) 
and the optimal closed-loop transfer function is 
Gs) Bee tO. 
Mls) = RG VS) = oss ps E10 
(11-69) 
200 


= 32 4+ 20s + 200 
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The following features of the design should be noted: 


1. The performance index is the integral square error with constraint on the 
control signal in the form of integral square control. No specifications are 
given in the form of overshoot, bandwidth, rise time, gain margin, and 
so on. 

2. The optimal control and the optimal closed-loop transfer function are 
determined without specifying the final system configuration. 


It is interesting to note that the optimal system represented by the transfer function 
of Eq. (11-69) has a damping ratio of 0.707 and a bandwidth of 14.14 rad/sec. 

There is a great deal of flexibility in arriving at the final system configuration and 
the transfer function of the controller. Figure 11-2(a) shows the system with a series 
controller. The transfer function of the series controller is determined as 


Maley 

GAs) = G(s) 1 — Mo(s) (11-70) 
_ 20s 
~ s + 20 


As an alternative, Fig. 11-2(b) shows the system with a feedback controller which is a 
tachometer, and series controller, with 


GAs) = 20 
and 


H(s) = 0.1s 


c(t) 


c(t) 


(b) 


Fig. 11-2. (a) Analyticaily designed system in Example 11-1 with a series 
controller. (b) Analytically designed system in Example 11-1 with a feed- 
back controller. 
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EXampLe 11-2 _ Referring to the system of Fig. 11-1, consider that 
as) =*>1 (11-71) 


The input is a unit step function. It is desired to determine the optimal closed-loop 
transfer function Mo(s) so that J, = minimum and J, < 1. 7 
_ Using the notation of Eq. (11-44), N = s —1, D =s?. Then, N = —s — 1 and 
D = s?, 

{k2DD + NN}* = {k2s4 — 52 4 1}* (11-72) 


The spectral factorization of Eq. (11-72) is carried out by writing 


k+st — $2 + | = (ans? + ays + ap)(azs? — ays + ay) 


11-73 
= ajs* — (at — 2azao)s? + a3 ee 
Equating like terms on both sides of Eq. (11-73) yields 
a, =k (11-74) 
a, =/2k +1 (11-75) 
a = (11-76) 
Thus 7 
{k2DD + NN}* = ks? +./2k + 1s +1 (11-77) 
and 
{k2DD + NN} = ks? ~./2k + 1s +1 (11-78) 
The second term on the right side of Eq. (11-47) is 
eh ae =a ee | ee (11-79) 
{k2DD + NN}- J, Ls(ks? —./2k FIs+D), 8 


where we have considered that the pole at the origin is slightly to the left of the imagi- 
nary axis. The optimal control is now found from Eq. (11-47), 


== 5S 
Ue Ee ie eA Sai 


subject to the determination of k. 
Using Eq. (11-39), and evaluating the integral with the help of Table 11-1, we have 


k = 0.378 
The optimal closed-loop transfer function is found by use of Eq. (1 1-48), 
—2.645(s — 1) 


M((s) = (11-81) 


s? + 3.55 + 2.645 
It is worth noting that the closed-loop transfer function contains the right-half- 
plane zero of G(s). This is a necessary condition for u(¢) to be bounded. In other words, 
if Mo(s) does not contain the term (s — 1) in its numerator in this problem, it would 
not be possible to satisfy the J, < 1 requirement. However, the analytical design 
formulation derived in this section naturally leads to the proper solution for this case. 


It should be pointed out that the analytical design can yield a physically 
realizable solution only if J, and J, are finite. Given an arbitrary input and 
process transfer function G(s), a minimum integral-square-error solution may 
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not exist. For instance, it is well known that the steady-state error of a type-0 
system is nonzero for a step input. Thus J, would be infinite if G(s) is of the 
form 


G(s) = 


K 
GtaGEDGLo: —ooere (11-82) 


11.3 Parameter Optimization 


The analytical design method introduced in Section 11.2 is restricted to single- 
input systems only. For multivariable systems, the spectral factorization problem 
causes the solution to be a great deal more complex. The advantage with the 
analytical design is that the configuration of the system to be designed is semi- 
fixed, so that the end result of the design is the optimal closed-loop transfer 
function. 

As a variation to the analytical design, we may consider a fixed-configura- 
tion system but with free parameters that are to be optimized so that the fol- 
lowing specifications are satisfied : 


J,= i : e(t) dt (11-83) 
I= f : u(t) dt <K (11-84) 


As in the analytical design, we consider the case when J, == K, and the 
problem becomes that of minimizing the following performance index: 


J=J,+R4, (11-85) 


where k? is the Lagrange multiplier whose value is to be determined. The 
system is optimized with respect to a given reference input. 

The advantage with the parameter optimization method is that it can be 
applied to systems with multiple inputs. The disadvantage is that the actual 
implementation of the design is quite tedious for complex systems without the 
use of a digital computer. 

Consider that the control system to be designed has a fixed configuration 
for the process and the controllers that contain m free parameters, K,, K2,..., 
K,. These parameters are to be determined so that J of Eq. (11-85) is minimized, 
subject to the constraint 

J,=K (11-86) 


Applying Parseval’s theorem and Table II-1, the performance index J is 
expressed as a function of the free parameters and k?; that is, 


J =J(K;, Kis... , Ka k?) (11-87) 


The necessary condition for J to be a minimum is 


ie i=1,2,...,n (11-88) 
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and the sufficient condition is that the following Hessian matrix is positive 


definite: 
my as oj 
0K? OK,0K, °°" oK,oK, 
07s oy os 
V?J =|0K,0K, 0K} ‘"' OK,0K, (11-89) 
Os os Chas 
|OK,0K, OK,OK, “'° 0K? 


Since 07J/0K,0K, = 07J/0K,0K,, the Hessian matrix is always symmetric. In 
addition to the necessary and sufficient conditions of Eqs. (11-88) and (11-89), 
the equality constraint of Eq. (11-86) must be satisfied. 

The following examples illustrate how the parameter optimization design 
is carried out. 


EXAMPLE 11-3 Consider the control system of Example 11-1. Let us use the cascade 
controller configuration of Fig. 11-2, with the controller parameters 
set as K, and K,. The block diagram of the system is shown in Fig. 

11-3. The problem is to determine the optimal values of K, and K2 such that 


ie i |e) dt = minimum (11-90) 


— ("2 = 7 
J [40a 2.5 (11-91) 


The reference input to the system is a step function with an amplitude of 0.5. . 


Fig. 11-3. Control system for parameter optimization. 


The problem is equivalent to that of minimizing 
joo 
Sati = a [E(s)E(—s) + 2U(s)U(—s)] ds (11-92) 
= j08 
From Fig. 11-3 we have 


_. R(s) 0.5(s + K2) _ 
ES) "= GG) + Aas + 10K, (11-93) 
and 
U(s) = E(s)G.(s) = qos (11-94) 


s* + Kos + 10K, 


Substituting Eqs. (11-93) and (11-94) in Eq. (11-92), and using Parseval’s theorem and 
Table 11-1, we have 
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7 = 0-25(10Ki + KF), pp _2.5Ki 
20K; K2 : 20K, K2 


Applying the necessary condition for J to be a minimum, we get from setting the 
necessary conditions and the equality constraint, 


(11-95) 


a =0 —0.25K3 + 5k?K}? =0 (11-96) 
OS. =0 Ki — 10K, — 10k2K}? =0 (11-97) 
OK, 
Jy = 2.5 Ki = 20K, (11-98) 
The last three simultaneous equations give the solutions 
K, = 20 K, = 20 k? = 0.05 (11-99) 


which are identical to the results found in Example 11-1. It can be shown that the 
Hessian matrix V2J is positive definite, so that the sufficient condition is also satisfied. 

The fact that K, equals K, in this problem is purely coincidental. We could have 
formulated a less flexible problem by assigning K, = K2,. Then there would be only 
one free parameter to optimize. The solution for such a situation would be quite 
simple for the design criteria given in Eqs. (11-90) and (11-91), since the optimal value 
of the parameter can be obtained by using only the constraint requirement of Eq. 
(11-91). 


11.4 Design of System with Specific Eigenvalues—An Application 
of Controllability?~® 


An interesting and useful application of state controllability is the design of a 
linear feedback control system with specific eigenvalues. The system under 
consideration may be represented by the block diagram of Fig. 11-4. The linear 
process is described by the state equation 


Xx = Ax + Bu (11-100) 
where the scalar control is 
u= —Gx+r (11-101) 


The matrix G is an | x n feedback matrix. Combining Egs. (11-100) and 
(11-101), the closed-loop system is represented by the state equation 


x = (A — BG)x + Br (11-102) 


Fig. 11-4, Linear system with state feedback. 


586 / Introduction to Optimal Control Chap. 11 


It can be shown that if [A, B] is a controllable pair, then a matrix G exists 
that will give an arbitrary set of eigenvalues of (A — BG). In other words, the 
roots of the characteristic equation 


|AI— (A — BG)| = 0 (11-103) 

can be arbitrarily placed. 
It has been shown in Section 4.7 that if a system is state controllable, it can 
always be represented in the phase-variable canonical form; that is, in Eq. 


(11-100), 
0 1 0 07 TOT 
0 0 1 0 0 
fa 0 0 0 0 BE 
0 0 0 1 
ja, Ay —~Gy-2 a case, ay al 


The reverse is also true in that if the system is represented in the phase- 
variable canonical form, it is always state controllable. To show this, we form 
the following matrices: 


= = 0 
_ = 0 
0 0 0 | 
0 0 
0 
0 . 
AB = : A7B = . A3B = ; 
5 ; ‘ 
1 
1 —a, 
—ay ay — a, 
7 ~ | at — aa | 


| aj + a,a,— a, 

Continuing with the matrix product through A”~'B, it will become apparent that 
regardless of what the values of a,,a,,...,4,, are, the determinant of S = 
[B AB A’B...A*'B] will always be equalto —1, since S is a triangular 
matrix with Is on the main diagonal. Therefore, we have proved that if the 
system is represented by the phase-variable canonical form, it is always state 


controllable. 
The feedback matrix G can be written 
G=[g: 8 ..- Sal (11-104) 
Then 
fy 0 1 0 0 
0 0 1 0 
0 0 0... O 
A — BG = (11-105) 
0 0 0 1 
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The eigenvalues of A — BG are then found from the characteristic equation 

| AL — (A — BG)| = 4" + (a, + 8,)AP + (G2 + Bn-)A > + 0 HF Gn + 81) 
=0 (11-106) 
Clearly, the eigenvalues can be arbitrarily chosen by the choice of g,, 22,..., 2, 


ExaAMpLe 11-4 Consider that a linear process is described by the transfer function 


Csy)_ 10 
U(s) — s(s + 1)(s + 2) 


It is desired to design a feedback controller with state feedback so that the eigenvalues 
of the closed-loop system are at —2, —1 +1, and —1 —/1. Since the transfer function 
does not have common poles and zeros, the process is completely state controllable. 

By direct decomposition, the state equations for Eq. (11-107) are written 


(11-107) 


x4 0 1 07 x1 0 
x, |) =| 0 0 1 |} x. |+] 0 jz (11-108) 
x3 0 ~2 -—3 jx; 1 
Since this is a third-order system, the feedback matrix G is of the form 
G=[g1 82 83] (11-109) 
The characteristic equation of the closed-loop system is 
A} + 3 + 83)A27 + (2 + 82)A + 81 =0 (11-110) 
and with the prescribed eigenvalues it is 
3+ 442+64+4=0 (11-111) 


Equating the like coefficients of the last two equations, we have 


&=4 e=4 g=1 
or 
G=[4 4 1 (11-112) 


The state diagram of the overall system is shown in Fig. 11-5. 


Fig. 11-5. Linear control system with state feedback for Example 11-4. 


Stabilizability® 


We have shown that if a system is completely controllable, its eigenvalues 
can be arbitrarily located by complete state feedback. This also implies that any 
unstable system can be stabilized by complete state feedback if all the states are 
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controllable. On the other hand, if the system is not completely controllable, as 
long as the uncontrollable states are stable, the entire system is still stabilizable. 


11.5 Design of State Observers!° 13 


Another area of design of control systems concerned with the concepts of 
controllability and observability is the design of state observers. Suppose that in 
the design of the state feedback controller discussed in Section 11.4, we deter- 
mined the feedback matrix G so that 
u(t) = —Gx(r) + r(t) (11-113) 

However, in order to implement the state feedback, we still need to feed 
back all the state variables. Unfortunately, in practice, not all the state variables 
are accessible, and we can assume that only the outputs and the inputs are 
measurable. The subsystem that performs the observation of the state variables 
based on information received from the measurements of the input u(t) and the 
output e(f) is called an observer. 

Figure 11-6 shows the overall system structure including the observer. The 
scalar control is ordinarily given by 


u(t) = Er(t) — Gx(z) (11-114) 
where E and G are matrices of appropriate dimensions. Figure 11-6 shows that 


the inputs to the observer are the output e(t) and the control uv. The output of 
the observer is the observed state vector x,(t). Therefore, the actual control is 


u(t) = Er(t) — Gx,(t) (11-115) 


We must establish the condition under which an observer exists. The 
following theorem indicates that the design of the state observer is closely 
related to the condition of observability. 


State 
observer 


Fig. 11-6. Linear system with state feedback and state observer. 


Theorem 11-1. Given an nth-order linear time-invariant system that is 
described by the dynamic equations, 

x(t) = Ax(t) + Bu(z) (11-116) 

c(t) = Dx(4) (11-117) 


where x is an n-vector, u is the scalar control, and ¢ is a p-vector. The state vector x 
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may be constructed from linear combinations of the output c, input u, and deriva- 
tives of these variables if the system is completely observable. 


Proof: Assuming that the system is completely observable, the matrix 
T=[D’ A’D’ (A)’D’... (A) 'D’)] (11-118) 
is of rank n. We shall show that the states can be expressed as linear combina- 


tions of the output ¢(z), the input u(s), and their derivatives. Starting with Eq. 
(11-117), we take the derivative on both sides with respect to t. We have 


é(t) = Dk) = DAx(t) + DBu(s) (11-119) 
or 
é(t) — DBu(t) = DAx(t) (11-120) 
Repeating the time derivative process to Eq. (11-120), we get 
&(@) — DBu(t) = DAX(t) = DA?2x(t) + DABu(t) (11-121) 
Rearranging the last equation yields 
&(t) — DBu(t) — DABu(t) = DA?x(t) (11-122) 
Continuing the process, we have, after taking n derivatives, 
c(t) = DBu*- )(t) — DABu*-2)(t) — ... — DA" Bu(t) = DA”™!x(#)_ (11-123) 
In matrix form, Eqs. (11-117) and (11-120) through (11-123) become 
c “| D 
¢ — DBu DA 
— DBu — 2 
ae =| PAY |x (1-124) 
ce — DBu®-») — DABu"-» — ... — DA""'Bu | DA"! 


Therefore, in order to express the state vector x in terms of ¢, u, and their 
derivatives, the matrix 
T=[D DA DA?...DA"']’ 
=(D’ A’D’ (A’)}*D’...(A’)""'D’] 
must be of rank n. 


There are many ways of designing a state observer, and there is more than 
one way of judging the closeness of x,(¢) to x(t). Intuitively, the observer should 
have the same state equations as the original system. However, the observer 
should have u(z) and ¢(¢) as inputs and should have the capability of mini- 
mizing the error between x(t) and x,(¢). Since we cannot measure x(f) directly, 
an alternative is to compare c(t) and ¢,(¢), where 


c(t) = Dx,(0) (11-125) 


Based on the above arguments, a logical arrangement for the state observer 
is shown in Fig. 11-7. The state observer design is formulated as a feedback 
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Fig. 11-7. Block diagram of an observer. 


control problem with G, as the feedback matrix. The design objective is to select 
the feedback matrix G, such that ¢,(t) will approach e() as fast as possible. 
When ¢,(f) equals e(t), the dynamics of the state observer are described by 
x,t) = Ax,(t) + Bu(z) (11-126) 
which is identical to the state equation of the system to be observed. In general, 
with uw and c(t) as inputs to the oberver, the dynamics of the observer are rep- 
resented by 
X(t) = (A — G_D)x,@) + Bu(t) + G,c() (11-127) 
The block diagram of the overall system with the observer is shown in Fig. 11-8. 
Since e(¢) and x(t) are related through Eq. (11-117), the last equation is also 
written as 
%(t) = Ax,(t) + Bu(t) + G.D[x(*) — x,(0)] (11-128) 
The significance of this expression is that if the initial values of x(t) and x,(¢) are 
identical, the equation reverts to that of Eq. (11-126), and the response of the 
observer will be identical to that of the original system. Therefore, the design of 
the feedback matrix G, for the observer is significant only if the initial condi- 
tions to x() and x,(r) are different. 
There are many possible ways of carrying out the design of the feedback 
matrix G,. One way is to utilize the eigenvalue assignment method discussed in 
Section 11.4. If we subtract Eq. (11-128) from Eq. (11-116), we have 


[x(t) — ¥.()] = (A — G_D)[x(2) — x,(2)] (11-129) 
which may be regarded as the homogeneous state equation of a linear system 


with coefficient matrix A — G,D. The characteristic equation of A — G,D and 
of the state observer is then 


|AI— (A — G,D)| = 0 (11-130) 
Since we are interested in driving x,(t) as close to x(t) as possible, the objective 


of the observer design may be stated as to select the elements of G, so that the 
natural response of Eq. (11-129) decays to zero as quickly as possible. In other 
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State feedback 


Fig. 11-8. Block diagram of a linear feedback system with observer. 


words, the eigenvalues of A — G,D should be selected so that x,(¢) approaches 
x(t) rapidly. However, it must be kept in mind that the approach of assigning 
the eigenvalues of A -- G,D may not always be satisfactory for the purpose 
of matching all the observed states to the real states, since the eigenvalues 
control only the denominator polynomial of the transfer relation, while the 
numerator polynomial is not controlled. In Section 11.4 the condition for the 
arbitrary assignment of the eigenvalues of (A — BG) given A and B has been 
established. We must first condition Eq. (11-129) so that the similarity between 
the two cases may be established. It is easy to see that the eigenvalues of 
(A — G,D) are identical to those of (A — G,D)’. The latter matrix is written 


(A — G,Dy = (A’ — D’G!) (11-131) 


Thus, invoking the results of Section 11.4, the condition of arbitrary assignment 
of the eigenvalues of (A — G,D) or of (A’ — D’G}) is that the pair [A’, D’] be 
completely controllable. This is equivalent to requiring that the pair [A, D] be 
completely observable. Therefore, the observability of [A, D] ensures not only that 
a state observer can be constructed from linear combinations of the output e, input 
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u, and the derivatives of these, but also that the eigenvalues of the observer can 
be arbitrarily assigned by choosing the feedback matrix G,. 

At this point an illustrative example may be deemed necessary to show 
the procedure of the observer design. 


EXAMPLE 11-5 Consider that a linear system is described by the following transfer 
function and dynamic equations: 


C(s) __ 2 
U6) ~ G@FDEFD (i132) 
X(t) = Ax(t) + Bu(t) (11-133) 
c(t) = Dx(#) (11-134) 
where 
a-( a] ®-L2] 
~[-2 3 “14 


D=[2 0] 


It is desired to design a state observer so that the eigenvalues of |AI — (A — G.D)| = 0 
are atA = —10, —10. 
Let the feedback matrix be designated as 


G, = re (11-135) 
8e2 


Fig. 11-9. State diagram of the observer and the original system for Exam- 
ple 11-5. 
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Then, the characteristic equation of the state observer is 


eee = ee A =“ (11-136) 
=A? + (2ge1 + 3A + (681 + 2 + 282) = 0 
For the eigenvalues to be at A = —10, —10, the characteristic equation should be 
A2 + 201 + 100 =0 (11-137) 
Equating like terms of Eqs. (11-136) and (11-137) gives 
Ge = 8.5 
8e2 = 23.5 


The state diagram for the observer together with the original system is shown in Fig. 
11-9. 

As was mentioned earlier, if the initial values of x(t) and x,(r) are identical, the 
responses of the observer will be identical to those of the original system, and the 
feedback matrix G, will have no effect on the responses of the observer whatsoever. 
Figure 11-10 illustrates the unit step responses of x,(¢) and x,,(¢) for the following 


8e, = 8.5 x) (t) 
8e2 7 23.5 
Xei(t) 


Xe(t) (Be) =8e2 = 1) 


Time (seconds) 


Fig. 11-10. State x(t) and the observed states of the observer in Example 
11-5. 
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initial states: 


0.5 
x) =["9 | 
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0 
x0) =| 9 | 


Shown in the same figure is the response of x,,(f) when the state observer is 
designed for eigenvalues at 4 = —2.5, —2.5, in which case g.; = 1 and 82 = 1. Since 
the state observer dynamics are now slower, it is seen from Fig. 11-10 that the Xei(t) 


response deviates more from the state x,(¢). 


Figure 11-11 illustrates the responses (ft) and x,2(t) for the two cases of observer 
design. The reason that both x.2(t) responses are not very close to the actual state 
X2(t) is due to the fact that the elements of the feedback matrix, g,; and g,2, appear in 
the numerator of the transfer function relation between X,(s) ~- X,2(s) and x2(0) 
— Xe2(0), but not in the relation between X;(s) — X.1(s) and x1(0) — x,;(0). Taking 
the Laplace transform on both sides of Eq. (11-129) and rearranging, we have 


X(s) — X.(s) = [sI — (A — GD) [x(0) — x,(0)] (11-138) 
where 
s+3 1 1 
[I — (A ~ G,Dy}-1 — b= 2 = 28e2_ 8 + 28011 (11-139) 


Xen(f) (Se = 8.5, 8e2 = 23.5) 


|s — (A — G,D)| 


Time (seconds) 


Fig. 11-11. State x2(t) and the observed states of the observer in Example 


11-5. 


Thus, we notice from Eq. (11-139) that selecting larger values for g,, and g,2 to 

give faster transient response for the observer will not affect the numerator terms of the 

+ X,1(s) response. However, a larger value of g,2 will increase the gain factor between 

X2(s) — X.2(s) and x2(0) — x,2(0). This explains the fact that in Fig. 11-11 the x,2(¢) 
response for g,. = 1 is a better observation of x(t) than the one for g,. = 23.5. 
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A more versatile design method for the observer may be effected by the use 
of a performance index on the error between x and x,. A popular performance 
index is the quadratic form, 


i= sf. (x — x.)'Q(x — x,) dt (11-140) 


The matrix Q is symmetric and positive semidefinite. The elements of Q 
may be selected to give various weightings on the observation of the states. 


Closed-Loop Control with Observer 


We are now ready to investigate the use of an observer in a system with 
state-variable feedback. The block diagram of such a system is shown in Fig. 
11-8, 

From Fig. 11-8 the state equations of the entire system are written 


x = Ax — BGx, + BEr (11-141) 
x, = (A — DG, — BG)x, + DG,x + BEr (11-142) 


A state diagram for the system is drawn as shown in Fig. 11-12 using Eqs. 
(11-141) and (11-142). The initial states are included on the state diagram, and 
the branch gains are matrix quantities. It can be easily shown that the system 
with the observer is uncontrollable (state) but observable. However, the lack of 
controllability is in all the states x and x,. The reason for this is simple; the main 
objective is to control x while keeping x, close to x. It is not necessary to control 
x and x, independently. 


O Xe(t}) = Xe 


Fig. 11-12. State diagram of the system shown in Fig. 11-8. 
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From Fig. 11-12 the transfer relations of the state vector and the observed 
state vector are derived. These are 


X(s) = [sI — (A — BG)]-'BER(s) — BGA~'x,, + [sI — (A — G,D — BG)]A~'x, 
(11-143) 
X.(s) = [sI — (A — BG)]"'BER(s) + (sI — A)A7'x,, + G,DA™'x, = (11-144) 
where 
A=s?I — 2A — G,D — BG)s + [G,.DBG + A(A — G,D — BG)] (11-145) 
When x, = X,9, it can be shown that 
X(s) = X,(s) = [sI — (A — BG)]-'BER(s) + [sI — (A — BG)]~'x, (11-146) 
Therefore, when the observer and the system have the same initial conditions, the 
two systems will have identical state and output responses. More important is the 
fact that the transfer relation in Eq. (11-146) is identical to that when the observer 
is absent; that is, the true state variables are fed back for control purposes. This 
means that when the initial states of the original system and the observer are 
identical, the responses of the system will not be effected by the feedback 
matrix G,. Since, in general, x,, 4X), the design of the observer, and subse- 
quently of G,, will affect the system response through the initial-condition term 
due to Xp, as indicated by Eq. (11-143). However, the steady-state response is due 


to the first term on the right side of Eq. (11-143), and the eigenvalues of A — BG 
are not functions of G,,. 


EXAMPLE 11-6 As an example of the design of a closed-loop system with observed 
state feedback, consider the linear process that has the transfer 


function 
C(s) _ _ 100 
UG) se +5) Cre) 
The dynamic equations of the process are written 
x(t) = Ax(rt) + Bu(t) (11-148) 
c(t) = Dx(r) (11-149) 
where 
cee Pelion 
A= B = 
0 —5 100 
D=[l 0] 
It is desired to design a state feedback control that is given by 
u=r-— Gx (11-150) 
where 
G=[e: 2e2] (11-151) 


The eigenvalues of the closed-loop system should be located at 4 = —7.07 + /7.07. 
The corresponding damping ratio is 0.707, and the natural undamped frequency is 
10 rad/sec. 

Assuming that the states x; and x, are inaccessible so that a state observer is to 
be designed, the overall system block diagram is identical to that of Fig. 11-8, with 
E= 1, 
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First, the pair [A, B] is completely controllable, so the eigenvalues of A — BG 
can be arbitrarily assigned. Also, it is simple to show that the pair [A, D] is completely 
observable, so that an observer may be constructed from c and u. 

The characteristic equation of the closed-loop system with state feedback is 

|AL — (A — BG)| = 0 (11-152) 
or 
A? + (5 + 100g2)A + 100g, = 0 (11-153) 


To realize the desired eigenvalues stated earlier, the coefficients of Eq. (11-153) must 
satisfy the following conditions: 
5 + 100g, = 14.14 
100g, = 100 
Thus g; = 1 and g, = 0.0914. 


The state diagram of the overall system, which includes the observer, is shown in 
Fig. 11-13. 


~ 8e2 


Fig. 11-13. State diagram of the system with observer in Example 11-6. 


The design of the observer may be carried out in the usual manner. The charac- 
teristic equation of the observer is 


JAI — (A — G.D)| = 0 (11-154) 


= [ee] (11-155) 
e2. 


where 
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Let us assume that the eigenvalues of the observer must be at A = —50, —50. 
These eigenvalues are of much greater magnitude than the real parts of the eigenvalues 
of the system. Therefore, the transient of the observer due to the difference between 
the initial states xp and x.»9 should decay very rapidly to zero. The corresponding 
values of g,, and g,2 are found to be 


&e = 95 


; 7025 (11-156) 
e2 = 


The system of Fig. 11-13 is simulated on a digital computer with G and G, as 
indicated above. The responses of x:(¢) when r(t) is a unit step function are computed 
and plotted as shown in Fig. 11-14 for x-9 = x9 = 0, and x, == 0, x. = [0.5 OY. 


X1(t) X19 = Xe10 


0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 


Time (second) 


Fig. 11-14. Unit step responses of x(t) and xe1(t) of the system in Example 
11-6. 


When X.9 = Xo, the response is that with the real state-variable feedback. When x, 
* Xeo, and the elements of G, are as given in Eq. (11-156), the step response of x;(t) 
is faster than the ideal x;(t), and the overshoot is greater. Also shown in Fig. 11-14 is 
the step response of x;(t) when the observer is designed to have its eigenvalues at 
A = —10 and —10, which correspond to g.; = 15 and g.2 = 25. The initial states of 
the observer are again given by x.9 = [0.5 OJ’. Note that since the observer dynamics 
are much slower in this case, the corresponding step response of x,(t) is also slower 
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than the true response, but the overshoot is still greater. The x.1(¢) responses are shown 
to follow their corresponding x,(t) responses very closely, starting from the initial 
state of x,:(0) = 0.5. 

It is interesting to investigate the effect of having various differences in the initial 
values between x,(t) and x,;(t). In practice, the initial value of x(t) (as well as that of 
the other state variables) is not fixed and could be of any value. The initial values of the 
observed states must be set so that they are as close to that of the real states as possible. 
For illustrative purposes, we set x(0) = xo = 0 and x,2(0) = 0 but vary x.1(0). Figure 
11-15 shows the unit step responses of x,(¢) when x,;(0) = 0, 0.25, 0.5, and 0.8, with 
G, =[15 25)’. The case with x.,(0) = x,(0) = 0 is the ideal response. These curves 
illustrate the importance of making x,9 as close to x9 as possible. 


Xe, = 0.25 


X19 = Xe19 = 0 


0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 
Time (second) 


Fig. 11-15. Unit step responses of x1(+) of the system in Example 11-6 with 
various values of x¢10. 


11.6 Optimal Linear Regulator Design!3-16 


One of the modern optimal control design methods that has found practical 
applications is /inear regulator design theory. The design is based on the mini- 
mization of a quadratic performance index, and the result is the optimal control 
through state feedback. The basic advantages of optimal linear regulator design 
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are as follows: 


1. The solution is carried out without cut-and-try; a mathematical 
algorithm leads to a unique solution. 

2. Can be used to design linear time-varying or time-invariant systems 
with multivariables. 

3. Guarantees stability. 


Consider that an nth-order linear system is described by the state equation 
X(t) = Ax(t) + Bu(s) (11-157) 


where x(t) is the n x 1 state vector and u(t) is the r x 1 control vector; A and B 
are coefficient matrices of appropriate dimensions. In general, A and B may 
contain time-varying elements. The design objective is that given the initial 
state x(t), determine the optimal control u°(¢) so that the performance index 


J = 4x'(t)Px(t,) + 4 f “'Ix’(NQx(t) + w()Ru()] dt (11-158) 


is minimized. The performance index J is known as a quadratic performance 
index, since P, Q, and R are required to be symmetric matrices. In addition, it 
is required that P and Q be positive semidefinite and R be positive definite. 

The first term on the right side of Eq. (11-158) is the terminal cost, which is 
a constraint of the final state, x(t,). The inclusion of the terminal cost in the 
performance index is desirable since in the finite-time problem, ¢, is finite and 
x(t,) may not be specified. 

The first term under the integral sign of J represents a constraint on the 
state variables. The simplest form of Q that one can use is a diagonal matrix, 
unless no constraint is placed on the states, in which case Q = 0. For an nth- 
order system, a diagonal Q may be defined as 


rg, O O ... OF 
0 gq, O 0 
Q=|0 0 q ... O (11-159) 


|O 0 0 ... |g, 


The ith entry of Q represents the amount of weight the designer places on 
the constraint on the state variable x,(¢). The larger the value of q,, relative to 
the other qs, the more limiting is placed on the state x,(t). The second term under 
the integral of Eq. (11-158) places a constraint on the control vector u(t). There- 
fore, the weighting matrix R has the same significance for u(t) as Q has for x(t). 
Physically, the time integral of u’(t)Ru(t) has the dimension of energy. Thus the 
minimization of the performance index of Eq. (11-158) has the physical inter- 
pretation of keeping the states near the equilibrium state x = 0, while holding 
the energy consumption to a reasonable level. For this design, the reference 
input is not considered and is set to zero, although the designed system may 
still be subject to nonzero inputs. The term “regulator” simply refers to the 
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condition that the primary purpose of the design is that the system is capable of 
damping out any initial state x(t,) quickly without excessive overshoot and 
oscillations in the state responses. 

The derivation of the necessary condition of the optimal control may be 
carried out in a number of ways. In this section we shall use the principle of 
optimality!’ and the Hamilton—Jacobi equation as development tools. 


Principle of Optimality 


Many algorithms and solutions in optimal control theory follow basic 
laws of nature that do not need complex mathematical development to explain 
their validity. One of these algorithms is the principle of optimality: An optimal 
control strategy has the property that whatever the initial state and the control 
law of the initial stages, the remaining control must form an optimal control with 
respect to the state resulting from the control of the initial stages. 

Figure 11-16 gives a simple explanation of the principle in the form of a 
state trajectory of a second-order system, Let us consider that the control 
objective is to drive the system from x(t.) to x(t,), with x(¢,) given, in such a way 
that the performance index 


z= ‘3 F(x, u) dt (11-160) 


is minimized. The state equations of the system may be that given in Eq. (11-157). 
Let t, be some intermediate time between f, and ft, (tf) < t, < t,), and x(t,) is 
the corresponding state, as illustrated in Fig. 11-16. We can break up the 
performance index in Eq. (11-160) so that for the time interval t; << tf < f,, it is 
expressed as 


ia f Fe, u) dt (11-161) 


Fig. 11-16. Principle of optimality. 
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The principle of optimality states that regardless of how the state reaches 
x(t,) at t = t,, once x(t,) is known, then using x(t,) as the initial state for the 
last portion of the state transition, in order for the entire control process to be 
optimal in the sense of minimum J, the control for the time interval 1, <t< te 
must be so chosen that J, is a minimum. In other words, the last section of an 
optimal trajectory is also an optimal trajectory. 

Using another more readily understandable example, we may consider that 
a track star desires to run a 440-yard distance in the shortest possible time. If he 
plans his strategy based on dividing the total distance into four parts, the 
optimal strategy for this minimum-time control problem, according to the 
principle of optimality, is 

No matter what the control laws of the first n parts, n = 1, 2, 3, are, the 
remaining 4 — n parts must be run in the shortest possible time, based on the state 
of the physical condition at the time of the decision. 


Hamilton-Jacobi Equation 


In this section we shall use the principle of optimality to derive the 
Hamilton-Jacobi equation, which is then used to develop the linear regulator 
design. 

To show that the theory is generally applicable to time-varying and non- 
linear systems, we shall use the following state equation representation: 


x(t) = f(x, u, 1) (11-162) 
where x(t) is an n-vector and u(t) is an r-vector. 
The problem is to determine the control u(¢) so that the performance index 
7s fF, u, t) dt (11-163) 
to 


is a Minimum. 
Let us denote the performance index over the time interval t <1< t, by 


Sia Mics u, t) dr (11-164) 
and its minimum value by 
S{x(t), ] = Min J = Min f ” F(x, u, 2) dt (11-165) 
Then i a 
S[x(t0), to] = Min J = Min [" F(x, u, 1) de (11-166) 
When ¢ = f¢;, . ee 
SIx(¢,), t7] = Min f “FG, u, t) dr = 0 (11-167) 


Now let us break up the time interval from ¢ to t, into two intervals: t<1<t 
+ Aandt+A<1t< ty. Then Eq. (11-165) is written 


S{x(®, ] = Min ( | s F(x, u, 1) dt + [ - F(x, u, 2) dt) (11-168) 
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Applying the principle of optimality we have 
Six(¢), 1] = Min ( j * Fx, u, t) dt + Six(t + A),t + Al) (11-169) 
where, according to Eq. (11-165), 
Six + A),¢-+ A] = Min [" F(x, u, 2) de (11-170) 
Let A be a very small time interval; then Eq. (11-168) can be written 
S[x(t), t] = Min (F(x, u, t)A + S[x(t + A),t + Al) + €o(A) (11-171) 


where €,(A) is the error function. 

The next step involves the expansion of S[x(¢ + A), ¢ + A]into a Taylor 
series. This would require the expansion of x(t + A) into a Taylor series about 
A = 0 first. Thus 


x(t + A)= x) +20 ca (11-172) 
Thus Eq. (11-171) is written 
S[x(t), {] = Min(F(x, u, )A + S[x@) + XA + ...5¢+A]) + €o(A) (11-173) 


The second term inside the minimization operation in the last equation is of the 


form S[x(t) + h(t), ¢-+- A], which can be expanded into a Taylor series as 
follows: 


SIX) +h, 1 + A] = Six, 1 + SRO MnGy + SRO A 
~ Ox(t) ot (11-174) 
+ higher-order terms 
Therefore, 
S[x(t + A), ¢ + A] = S[x(t) + f(x, u, NA+ ...,¢+ A] 


= SK, + ISO. A p(x, u, 1d + 2K: 1 9 


+ higher-order terms (11-175) 


where we have replaced x by f(x, u, ¢) 
Substituting Eq. (11-175) into Eq. (11-173), we have 


Six), = Min( F(x, u, DA + S{x(0), 4] + y Spo lex, u, A 
+ SEO. 4) + eA) 


where €,(A) is the error function, which includes the higher-order terms in Eq. 
(11-175) and €,(A). 

Since S[x(¢), t] is not a function of the control u(t), Eq. (11-176) is sim- 
plified to the following form after cancellation and dropping the common 
factor A: 


— SEO, t) 


(11-176) 


= Min (F(x, 0, ) + & ates POA Fx, wf) + e(A) (11-177) 
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As A approaches zero, Eq. (11-177) becomes 
— SROs fee = Min (Fox, w+ 3% ISX, 1 roy uy, ») (11-178) 
=i ox ‘i(t) 
which is known as Bellman’s equation. 
The necessary condition for the last equation to be a minimum is determined 
by taking the partial derivative on both sides of the equation with respect to u, 
and setting the result to zero. We have 


OF(x, u, t) | & OS[x(0), OF Ax, ut) _ : 
aug) At dxdt) du) (11-179) 


or in matrix equation form, 


OF(x, u,t) , Of(x, u, 2) OS[x(t), A] _ : 
jug) + ona) xy)? (it=180) 


where of(x, u, t)/du(t) denotes the matrix transpose of the Jacobian of f(x, u, t); 


that is, 
of, Of, fn 
Ou, Ou, Ou, 
of, of, of, 
ee du, Gu, ‘°° Ou, |= (Jacobian of fy (11-181) 
of, of, Of 
du, du, “°° du, 


Once the optimal control u°(r) is determined or known, Eq. (11-178) becomes 
dS[x°(2), 1] OS[X°(1), th ppeo no yy . 
Se + Few, D+ sw.) = 0 (11-182) 


where all the variables with superscript zeros indicate optimal quantities. The 
sum of the last two terms in the last equation is also known as the Hamiltonian 
A(x°, u°, t). Thus Eq. (11-182) is written 


osx oO, Vs A(x°, w, 1) = 0 (11-183) 


which is known as the Hamilton-Jacobi equation and is the necessary condition 
for the control to be optimal in the sense of minimum J. 
Derivation of the Differential Riccati Equation (Finite-Time Problem) 


Now we are ready to use the Hamilton-Jacobi equation to derive the solu- 
tion of the linear regulator problem. Consider the system 


(1) = Ax(1) + Bu(s) (11-184) 


with the initial condition, x(t,) = X9. The design problem is to find the optimal 
control u°(#) such that the performance index 


J = 4x'(t)Px(t,) + 4 ft [x’(DQx(t) + u’(t)Ru(1)] at (11-185) 
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is a minimum. The matrices P and Q are symmetric and positive semidefinite, 
and R is symmetric and positive definite. 

Let the minimum of J be represented by S[x(t), t]. Then, from the develop- 
ment of the last section we know that the necessary condition of optimal 
control is that the Hamilton-Jacobi equation must be satisfied. For the present 
case, Eq. (11-178) is written 


— 80.4 — in(+x'OOx@ + + wORaG) + [Ax@) + Buy SRO) 


(11-186) 
To carry out the minimization process, we differentiate both sides of Eq. 


(11-186) with respect to u(t), and we have the optimal control after setting the 
result to zero: 


u(t) = RB SO. (11-187) 


It remains to solve for 0S[x°(2), t]/@x°(t) in order to complete the expression of 
the optimal control. Substituting Eq. (11-187) into Eq. (11-186), we have 


a Pstx OH t _ FOO at 5 (ee (2), ‘Ny BR-'B’ (Se (t), 4) 


ox°(t) x°(t) 
on, 47 OS[X(E), f] dS[x°(2), t] ip (OS[X°O, t] 
+ xa Se (Seid ot ) BR-'B (Sea ) 
(11-188) 


The last ne is simplified to 


— 9six, @, f)_ 1 x Qx°(t) — + +(e, ty ‘y BR-'B’ oS [x° ey t] 
(11-189) 
+ xa SEO 


Since Q is a symmetric matrix, it can be shown that S[x°(t), r]is a quadratic 
function of x°(t). Thus we let 


S[x°(t), t] = 4x°"()K(1)x°(t) (11-190) 
where K(f) is an m X nm symmetric matrix. 


The optimal control is determined in terms of K(t) by substituting Eq. 
(11-190) in Eq. (11-187). We have 


u(t) = —R7-'B’K(t)x°(t) (11-191) 
Substitution of Eq. (1 a in Eq. (11-189) yields 


aK x? 


+¥'O a= + X"OWO — + x°’()K(t)BR-'B’K(2)x°(t) 


+ x°(NA'K()x°(1) (11-192) 
The last term in Eq. (11-192) can be written 
x°'(t)A’K(t)x°(t) = 4x°"(O[A’K(t) + K(Z)A]x°(t) (11-193) 
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since both sides of the equation represent scalar quantities. Thus, using Eq. 
(11-193) and comparing both sides of Eq. (11-192), we have 


EG) = K(t)BR-'B’K(t) — K(t)A — A’K(t) — Q (11-194) 


which is known as the Riccati equation. The matrix K(¢) is sometimes called the 
Riccati gain matrix. The boundary condition needed to solve the Riccati 
equation is obtained from Eq. (11-190) by setting ¢ = t,. Then 
K(t,) = P (11-195) 
Another important property of K(¢) is that it is positive definite, since otherwise, 
S[x°(t), t] would be negative. 
In summarizing the solution of the optimal linear regulator problem, the 
optimal control is given by Eq. (11-191) in the form of state feedback; that is, 
w(t) = —G(t)x°() (11-196) 
where 
GQ) = R-'BK® (11-197) 
is the time-varying feedback gain matrix. The Riccati gain matrix K(f) is solved 
from the Riccati equation of Eq. (11-194), with the boundary condition of 
K(t,) = P. The state equation of the optimal closed-loop system is given by 


x(t) = [A — BR™'BK())x() (11-198) 
The block diagram of the feedback system is shown in Fig. 11-17. 


R7'B’K(t) 


Fig. 11-17. Implementation of the optimal linear regulator design. 


A few remarks may be made concerning the solution of the linear regulator 
problem. It should be noted that the present consideration has a finite terminal 
time ¢,, and nothing is required on the stability, the controllability, or the 
observability of the system of Eq. (11-184). Indeed, the finite-time linear 
regulator problem does not require that the process be observable, controllable, 
or stable. 

The Riccati equation of Eq. (11-194) is a set of n? nonlinear differential 
equations. However, there are only n(m — 1) unknowns in K(¢), since the 
matrix is symmetric. 
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We shall postpone the discussion on the solution of the differential Riccati 
equation, Eq. (11-194), until we have investigated the infinite-time problem; 
that is, ty = oo, 


Infinite-Time Linear Regulator Problem 


Now let us consider the infinite-time regulator problem for which the 
performance index becomes 


J= 4] Ox + wR] at (11-199) 


Notice that the terminal cost is eliminated from J, since as ¢ approaches 
infinity, the final state x(¢,) should approach the equilibrium state 0, so that the 
terminal constraint is no longer necessary. The same conditions of positive 
semidefiniteness and positive definiteness are placed on Q and R, respectively, 
and all the derivations of the last section are still valid. However, the infinite- 
time linear regulator problem imposes additional conditions on the system of 
Eq. (11-184): 


1. The pair [A, B] must be completely controllable. 
2. The pair [A, D] must be completely observable, where D is any 
n X n matrix such that DD’ = Q. 


The solution of the linear regulator problem does not require that the 
process is stable; in the finite-time case, controllability is not a problem, since 
for finite t,, J can still be finite even if an uncontrollable state is unstable. On 
the other hand, an unstable state that is uncontrollable will yield an unbounded 
performance index if t, is infinite. The observability condition is required 
because the feedback system of Eq. (11-198) must be asymptotically stable. The 
requirement is again tied in with the controllability of the system in ensuring 
that the state vector x(t) approaches the equilibrium state as t approaches 
infinity, since observability of [A, D] is equivalent to the controllability of 
[A’, D’]. A complete proof of these requirements may be found in the litera- 
ture, 13-16 

For the infinite-time case, the Riccati equation in Eq. (11-194) becomes a 
set of nonlinear algebraic equations, 


KBR-'B’K — KA — A’K—Q=0 (11-200) 


since as ¢, approaches infinity, dK(t)/dt = 0, the Riccati gain matrix becomes a 
constant matrix. The solution of the Riccati equation, K, is symmetric and 
positive definite. 


Solution of the Differential Riccati Equation 


A great deal of work has been done on the solution of the Riccati equation, 
both for the differential form and for the algebraic form. In general, the alge- 
braic Riccati equation of Eq. (11-200) is more difficult to solve than the differ- 
ential equation of Eq. (11-194). 
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The differential Riccati equation is generally solved by one of the following 
methods: 


1, Direct numerical integration. 
2. Matrix iterative solution. 
3. Negative exponential solution 


The direct numerical integration method simply involves the solution of the 
nonlinear differential equations backward in time on a digital computer, 
knowing K(¢t,). The matrix iterative method is effected by writing dK(t)/dt as 


dK(t) __ |. K(t + A) — K(s) 
a lim (11-201) 


A-0 
Equation (11-194) can be approximated by a set of difference equations which 
are then solved iteratively backward in time. 


Negative Exponential Solution 
Let us define the vector 0S(x, 2)/0x(t) as the costate vector y(t); that is, 


oe yi) (nx 1) (11-202) 


From Eggs. (11-187), (11-196), and (11-197), y(t) is related to the Riccati gain 
K(¢) and the state vector x(t) through the following relation: 


y(t) = K@)x(2) (11-203) 

Taking the derivative on both sides of Eq. (11-203), we have 
¥(t) = K()x(1) + K(OX(0) (11-204) 
Substituting Eqs. (11-194) and (11-184) in Eq. (11-204) and simplifying, we have 
y(t) = —Qx(t) — A’y@) (11-205) 


which is referred to as the costate equation. 
Equations (11-198) and (11-205) are combined to form the canonical state 


equations, 
x(4) ws A —BR- - 7 
iol & —A' y(t) (11-206) 


which represent 2n linear homogeneous differential equations. The 2” boundary 
conditions needed to solve Eq. (11-206) come from the n initial states, x(¢,), and 


y(t,) = K(,)x(¢,) = Px(t,) (11-207) 
Let the coefficient matrix of the canonical state equations in Eq. (11-206) be 


represented by 
A -—BR-'B’ 
M = | (11-208) 
—Q =AP 
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The matrix M has the following properties: 


1. M has no purely imaginary eigenvalues. 
2. If 4, is an eigenvalue of M, then the negative complex conjugate of 
4, is also an eigenvalue; that is, : 


A, = —aF (11-209) 


Let W be the 2n x 2n similarity transformation matrix which transforms M 
into a diagonal matrix T. Then 


A: 0 
poe niW | ai | (11-210) 


where A is ann X n diagonal matrix that contains the eigenvalues of M with 
positive real parts (in the right-half plane). 
Let W be partitioned as follows: 


Ww,,:' WwW 
w= Werte | (11-211) 


where W,,, W,,., W,,, and W,, are n x n matrices, The transformed state and 
costate variables are denoted by &(¢) and $(2), respectively, and are related to the 
original variables through the following relation: 


| 2 We : We FA (11-212) 
y(¢) Wi | W22 ILI 


Equation (11-207) leads to the following boundary condition for the 
transformed state equations 


$(t>) = —(Wa2 — PW,2)-1(W2, — PW, )&(t,) (11-213) 
The transformed canonical state equations are written 
Ba = ES at BY | Fal (11-214) 
9) 0: AILIM 
The solutions of the last equation are 
R(t) = eA“QUE,) (11-215) 
I) = eh F(E,) (11-216) 


Since it is awkward to work in backward time, let us introduce a time 
variable, t, which represents the time from ¢ until the final time t,: 


t= ty est 3 
Let 
a(t) = X(t) = Re, — (11-217) 
9(t) = Yr) = Ya, — (11-218) 
Equations (11-215) and (11-216) become 
R(r) = eA K(0) (11-219) 


P(r) = e- 4 ¥(0) (11-220) 
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Since A represents a diagonal matrix with eigenvalues that have positive 
real parts, the solutions of Eq. (11-219) will increase with 7. Thus we rearrange 
Eq. (11-219), and when it is combined with Eq. (11-220), we get 


BM = ee 0 ern 
P(t) | £0 eA || HO) Che2e)) 
Now Eq. (11-221) represents solutions that have only negative exponentials. 


Using the boundary condition of Eq. (11-213), the relation between ¥(0) and 
R(0) can be written 


YO) = —(W,,, — PW,.)-1(W., — PW,,)X(0) (11-222) 
Substitution of Eq. (11-222) into Eq. (11-221), the relation between ¥(r) and 
X(t) is established: 


Yq) = —e- (Wa, — PWi2)" (War — PWyiJo-*X (rz) (11-223) 
Let 
H(t) = —e-“*(W,. — PW,,)"1(W2, — PW, ,)e~** (11-224) 
Equation (11-223) becomes 
P(r) = H(r)X(z) (11-225) 
In order to return to the variables x(¢) and y(#), we substitute Eq. (11-225) in Eq. 
(11-212) and using Eqs. (11-217) and (11-218), we have the relationship between 
y(t) and x(Z), 


y(@) = [W,, + W2,H(c)[W,, + W,2HG))'x(2) (11-226) 
Comparing the last equation with Eq. (11-203), the Riccati gain matrix is 
written 
K(t) = [W2, + W2.H(t, — Wi, + Wi H(t, — (11-227) 
or 


K(t, — t) = [W,, + W.,H(t)][W,, + W,.2H(2)] (11-228) 


Although we have a noniterative solution for K(t), because it is time dependent, 
in general, for high-order systems, even a computer solution will be quite com- 
plex. 


Solution of the Algebraic Riccati Equation 


In the infinite-time case, the Riccati equation is a matrix algebraic equation 
given by Eq. (11-200). Based on the negative exponential solution for the 
finite-time problem obtained in Section 11.5, we can obtain the solution of the 
algebraic Riccati equation by simply taking the limit as t approaches infinity, 
since 

t=t,—t= 00 ~t= 00 (11-229) 


Thus, from Eq. (11-224), 
lim H(t) = lim H(t, — t) = 0 (11-230) 


and Eq. (11-228) gives 
K = lim K(¢, — t) = W,, Wii (11-231) 
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Although the above solution is of a very simple form, in general, to deter- 
mine the matrices W,, and W,, requires the solution of the eigenvalues and the 
eigenvectors of the 2n x 2n matrix M. For high-order systems, a computer 
solution becomes necessary. 

In order to illustrate the solution of the Riccati equation, we shall first 
consider the optimal linear regulator design of a first-order system and carry 
out the design by pencil and paper. Then a higher-order system will be designed 
with the aid of a digital computer. 


EXAMPLE 11-7 Consider that a linear time-invariant system is described by the 
state equation 
X(t) = —2x(t) + u(t) (11-232) 
with the initial condition given as x(to). It is desired to determine the optimal control 
u°(t) such that 
= 4x%(te) + +{" (x2(t) + u2(t)) dt = min. (11-233) 
to 


We shall first consider that the final time ty is finite. From Eqs. (11-232) and (11-233), 
we identify that A = —2, B=1, P=1, Q =1, and R=1. Using the negative 
exponential method, we form the matrix M in Eq. (11-208), 


M = | ‘ | = ss 7 (11-234) 
Sao. igh Needs 
The eigenvalues of M are A, = —,/5 and A, = ,/5. The eigenvectors of M are 
found to be 
1 1 
=, aa 11-235 
o Fea ma 4 ( ) 
Then 
Wi, Wir 1 ] 
W= = | (11-236) 
Wr Warr 0.235 —4.235 


It is important to note that the eigenvectors should be so arranged in W that they 
correspond to the requirement of the matrix T in Eq. (11-210). Substituting the ele- 
ments of W, P = 1, and A =A, =./5 in Eq. (11-224), we get 

H(t) = —0.146e-25* (11-237) 
The time-varying Riccati gain is obtained by substituting H(t) in Eq. (11-228). Thus 
_ 0.235 + 0.6189e—2¥5* 
K(t; —T) = 1 = 0.146e-203% (11-238) 
We note that when ¢ = f;, T = 0, K(t;) = P = 1, which agrees with the boundary 
condition on K(t;). 

Figure 11-18 gives a plot of K(t) as a function of t. The steady-state solution of 
K(#) is obtained from Eq. (11-238) by setting t —> —co. 

For the infinite-time problem, t; = co, Since the system in Eq. (11-232) is com- 
pletely controllable, the optimal solution exists, and the constant Riccati gain K is 
solved from Eq. (11-238) by setting tT = co. Thus 

K = 0.235 (11-239) 
which is also the steady-state value of K(t). 
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Steady-state 0.52 KY) 
value of K(t) 
0.245 


0.235 


0.5 


0.306 
te 1 ty Oo tr 
tr - 0.3 


| nen al 


Fig. 11-18. Time-varying Riccati gain. 


The optimal control for the finite-time problem is 
ot) = —R-'B’K(t)x(t 
u(t) Ox) ere 
= —K(t)x(1) t<ty 
and that of the infinite-time problem is 
u(t) = —0.235x(t) (11-241) 
The state diagram for the feedback system designed for the infinite final time is 
shown in Fig. 11-19. 


— 0.235 


Fig. 11-19. Optimal linear regulator system in Example 11-7. 


EXAMPLE 11-8 In this example we consider the linear regulator design of the control 

of a simplified one-axis model of the Large Space Telescope (LST). 

The LST, which will be launched into orbit in 1980, is an optical 
space telescope aimed at observing stars that cannot be observed by ground-stationed 
telescopes. One of the major control problems in the design of the LST control system 
is the pointing stability of the vehicle. In addition to the accuracy requirement, the 
LST vehicle should be maintained at its equilibrium attitude position during operation. 
This is a typical regulator design problem. 

The block diagram of the simplified one-axis model of the system is shown in 
Fig. 11-20. An equivalent state diagram of the system is shown in Fig. 11-21, from which 
are written the state equations 

x@ = Ax(t) + Bu(t) (11-242) 
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Fig. 11-20. Block diagram of a simplified one-axis model of the LST. 


— K; 


Fig. 11-21. State diagram of the simplified LST system. 


where 


TO 1060 0) 
0 0 z 0 
Peto: qe. ol 
J, 
}0 0 -K, i 
0 
ee 0 
0 
K; 
The system parameters are defined as: 
H = 600 ft-lb-sec control moment gyro angular momentum 
J, = 2.1 ft-lb-sec? gimbal inertia 
K, = 9700 ft-lb/rad gimbal-rate loop integral gain 


K, = 216 ft-lb/rad/sec gimbal-rate loop proportional gain 
J, = 105 ft-lb/rad/sec vehicle inertia 
The design objective is to find the optimal control that minimizes the following 


performance index: 
f= [: [x'Ox(1) + Ru2(N)] dt (11-243) 
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where 
qi 0 0 0 
0 gq 0 O 
= 11-244 
Q 0 0 gq 0 ( ) 
0 0 O @& 


Since the states x; and x2 represent the vehicle displacement and velocity, respec- 
tively, and are of primary interest, more weights are placed on these variables in the 
specification of the elements of Q. We let gq, = 5 x 107,g2, = 5000,97; =q4 = 1, and 


R=1. 
na optimal control is given by 
u(t) = —R-'B’Kx(s) (11-245) 
where K is the positive definite solution of the algebraic Riccati equation, 
—KA — A’‘K + KBR-'BK — Q=0 (11-246) 


The solutions of the Riccati equation and the optimal control are obtained on a digital 
computer. The eigenvalues of the feedback system are 


2.75 9700 1.375 + 72.33 —1.375 — j2.33 
The feedback matrix is 


G =[7071 5220 10.6 0.99] (11-247) 


The state diagram of the feedback system with state feedback is shown in Fig. 
11-22. An input is added to the system through a gain of 7071. The latter is included so 
that the output of the system will follow a step function input without steady-state 
error. Figure 11-23 shows the responses of x; (8,) and x2 (6,) when the input is a step 
function with a magnitude of 5 x 10-8 rad. The initial conditions of the system are 
set to zero. 


r(t) u(t) 


~— 7071 


Fig. 11-22. State diagram of the LST system with state feedback from 
linear regulator design. 
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Fig. 11-23. Time responses of x1(t) and x2(t) of the LST system when the 
input is a step function. 


11.7. Design with Partial State Feedback 


It is demonstrated in Section 11.5 that an observer can be designed for an 
observable system to observe the state variables from the output variable. 
However, in general, the complexity of the observer is comparable to that of the 
system. It is natural to seek a design procedure that relies on the use of feedback 
from only the accessible state variables through constant feedback gains. It 
should be pointed out that control is achieved by feedback through constant 
gains from the accessible states, and no dynamics are involved in the controller. 
Of course, the design problem would only have a meaningful solution if the 
system is stabilizable with feedback from the accessible state variables. 
Given the linear time-invariant system 


x(t) = Ax(t) + Bu(t) (11-248) 
where 
x(t) =n xX | state vector 
u(t) = scalar control 


it is assumed that the system is completely controllable. 
Let the accessible state variables be denoted by the vector y(t) (m x I, 
m <n), and 
y(t) = Cx() (11-249) 
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where C is an m X n matrix with constant coefficients. It is assumed that C has 
full rank; that is, the rank of C should be at least equal to m. 
The design problem is to find the partial state feedback control 


u(t) = —Fy(t) (11-250) 


where F is an 1 x m feedback matrix such that the designed system satisfies a 
certain performance index. The performance index chosen for this design is 


J= f "Ex’()Qx(t) + Ru2(t)] dt (11-251) 


where Q is a symmetric positive semidefinite matrix and R is a positive constant. 
The design objective is to find the optimal control u(t) such that J is minimized. 
The reason for the choice of this performance index is that the design can be 
associated with the linear regulator design. 

Substitution of Eq. (11-249) in Eq. (11-250) yields 


u(t) = —FCx(z) (11-252) 
or 
u(t) = —Gx() (11-253) 
where 
G=FC=[g, g. ... Zl (11-254) 


It has been shown!? that the control in Eq. (11-253) is optimal in the sense 
of minimizing the J in Eq. (11-251) for some Q and R if and only if 


|1 + GGjol — A)-'B| > 1 (11-255) 
for all real w. 
It is interesting to note that the transfer relation between x(s) and u(t) is 


X(s) = (sl — A)~'BU(s) (11-256) 


The loop transfer function of the system is G(s] -. A)"'B. Thus 1+ 
G(sI — A)~!B is equivalent to the function 1 + G(s) in the classical control 
notation, and the condition of Eq. (11-255) is equivalent to the sensitivity 
relation of Eq. (9-74). In other words, the optimal system designed in the sense 
of minimizing J in Eq. (11-251) is that the Nyquist locus of G(j@I — A)7'B 
must not intersect or enclose the unit circle centered at (—-1, j0) in the complex 
function plane. Therefore, the system designed based on the optimal linear 
regulator theory must all satisfy Eq. (11-255). 

The design strategy here is to utilize the condition of Eq. (11-255) to select 
a weighting matrix Q that is positive semidefinite. The resulting G is then 
considered as the optimal feedback gain corresponding to that Q. The approach 
follows that of the inverse problem'3 of the linear regulator design, which 
involves the determination of the weighting matrices once the feedback matrix 
is known. 

For convenience, we let R = 1, since it is relative to the magnitudes of the 
elements of Q. Let p(s) represent the characteristic equation of the closed-loop 
system with partial state feedback; that is, 
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p(s) = |sI — (A — BG)| (11-257) 


Since the system is controllable, it can be represented in phase-variable canonical 
form. The matrices A and B are written 


TO 1 0 0 ... = =6<0 0 
0 0 1 0 0 0 
gal & 98 98 T ay 0 p=|° | ai2se) 
0 0 0 0 I 
—a, —~A, —a3 —ay, —a, ep 


The characteristic equation of A is denoted by 
qs) = |sl — A| = s"+ a,s7"! + 4,_,97+ ...+a, (11-259) 


The characteristic equation of the closed-loop system is written 


p(s) = 8” + (a, + g,)8" 1 + ...4+ (a, + 81) (11-260) 
Then ; 
a4 5 
AY 
s2 
I— A)'B = —— : 
(s y= 5 ‘ (11-261) 
st} 
and 
G(sI — A)"'B = GS") + Sy 8"™* HT (11-262) 
q(s) 
Thus 
[L + Got — A)By = ae - (11-263) 


In view of Eq. (11-255), we can write 
[1 + GGol — A)'BE = [1 + G(jol — AB] + G(—jol — A)'B] 
_ PUja)p(—j @) 11-264 
~ q(ja)q(—jo) = ( ) 
Subtracting | from both sides of the last equation, we have 
P(jo)p(—ja) — qjo)4(—jo) ~ 9 (11-265) 
q(jo)q(—jo) 
Let the numerator of the last equation be factored as 
PUjo)p(—jw) — q(jo)q(—jo) = djo)d(—jo) (11-266) 
where 
d(s) = d,s*?=' + d,_ys" 27+... +4, (11-267) 


Equation (11-267) is of the (n — 1)st order since the s" terms in p(s) and q(s) are 
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canceled in Eq. (11-266). Let 


dy 
d, 
D=|- (11-268) 
d, 
Then 
D(sI — A)" B = %) (11-269) 


q(s) 
Equation (11-264) is written as 


is ; 1B] — A jo) d—jo) 
1 + G( jal — A)“'B)[l + G(—jol — A)-'B] = 1 4+ SAS : 
{1 + Gj ) B][ + G(—ja )-B] qjo)q—Jo) (11-270) 
= 1+ B(—jol — A’)"'D’D( jal — A)-'B 
It has been shown by Anderson and Moore’? that for G to be the optimal 
feedback matrix, it is necessary that 


[1 + G(joI — A)“'B][] + G(—jal — A)~'B) 
= 1+ B(—jol — A’)"'!Q(jaI — A)'B 
Comparing Eqs. (11-270) and (11-271), we have 
Q=DD (11-272) 


Equations (11-266), (11-272), and the condition that Q is positive semi- 
definite form a design procedure for the partial state feedback. It should be kept 
in mind that since the system may not be stabilizable, or the inverse problem 
does not exist, an optimal solution may not always be possible. 


(11-271) 


EXAMPLE 11-9 Consider the dynamic equations of a linear time-invariant system, 
x(t) = Ax(t) + Bu(t) (11-273) 
Yt) = x2(t) (11-274) 


el pal. Bala 


It is desired to design a closed-loop system by feeding back only x,(t) through a 
constant gain, so that the performance index 


where 


J= i [x’OQx(t) + u2(2)] dt (11-275) 
is minimized. The control is u(t) = —Gx(1). 
The characteristic equation of A is 
Qs) =|sI-—A|=s? +1 (11-276) 
and the characteristic equation of the closed-loop system with feedback from x2 is 
p(s) = |sI — (A — BG)| = s? + gos + 1 (11-277) 


where 
G=[0 g2] (11-278) 
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For the second-order system, 


d(s) = d,s +d, (11-279) 
and 
D=[d, 4d] (11-280) 
Then the weighting matrix Q is of the form 
dz | 
=D/D= (11-281) 
Q ie di 
From Eq. (11-266) we have 
pores = o4 2 — g2\c2 1 
P(s)p(—s) = s* + (2 — g9)s* + (11-282) 
= q(s)q(—s) + d(s)d(—s) = s* + (2 — d?)s? + d3 +1 
Therefore, 
d,=0 dz = g} 
and 


0 0 0 0 
= = 11-283 
elo ailnlo eal ae 


This result shows that Q must be of the form defined in Eq. (11-283), or the optimal 
solution does not exist for the problem given here. However, it does not mean that 
given any other positive semidefinite Q an optimal linear regulator solution does not 
exist. 

The nonzero element of Q, d3, represents a constraint on the state x. which is the 
derivative of x,. It is reasoned that if we place more constraint on x2, the overshoot of 
the system will be reduced. This is verified by assigning different values to d,, and 
observing the effect on the roots of the characteristic equation of the feedback system. 


di=1:  p(s)=s? +s+1 damping ratio € = 0.5 
di=2:  p(s)=s?+./2s4+1 damping ratio € = 0.707 
di=4; p(s)=s?+2s4+1 damping ratio € = 1.0 


In more complex systems, Eq. (11-266) leads to a set of nonlinear equations 
that must be solved to obtain the elements of D and G. The problem is simplified 
by observing that the elements in the last row of the matrix A in Eq. (11-258) 
already represent feedbacks from the state variables. Therefore, it is logical to 
absorb these coefficients in the feedback matrix G. Then the modified matrix 
A would be 


0 1 0 0 
001... 0 
Bl wesley een eae (11-284) 
00 0 1 
0 0 0 0 
The state equations of the system become 
x(t) = A*x(t) + Bu(s) (11-285) 


and the state feedback control is 
u(t) = —G*x(n) (11-286) 
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where 
G*=G—[0 0... 0 JA (11-287) 
=[g.-4 g—a@,...8,—4,] 
It is simple to see that the characteristic equation of A* will always be 
q(s) = s” (11-288) 


The following example will illustrate this simplified procedure. 


EXAMPLE 11-10 Consider the linear time-invariant system 
X(t) = Ax(t) + Bu(t) 


where 
0 1 0 0 
A=!0 0 1 B=| 0 
0 -—2 -—3 1 
We wish to find the feedback gain matrix G =[g, 0 0] such that the performance 
index 


ee in [x(NOx(t) + u2(N)] at 


is minimized. The form of G given indicates that only the state x, is fed back for 
control. Using Eq. (11-287), G* =[g, 2 3]. 
From Eq. (11-284), the characteristic equation of the closed-loop system is 


P(s) = |sI — (A — BG)| = |sI — (A* — BG*)| 


(11-289) 
= s3 + 3s? + 25+ gy 
Let 
d(s) = d3s* + das + dy (11-290) 
From Eq. (11-266), we have 
s)p(—s) — q(s)q(—s) = Ss* + (681 — 4)s? + gi 
P(s)p(—s) — 9(s)q(—s) (6g, — 4) i (11-291) 


= d3s* + (2d,d3 = d3)s? + d? 


Thus equating the coefficients of corresponding terms in the last equation, we have 


di = gi (11-292) 
dj = (11-293) 
2d,d,; — di = 6g, —4 (11-294) 
Substitution of Eqs. (11-292) and (11-293) into Eq. (11-294) yields 
di = 4 — 1,5278d, (11-295) 
Since d3 must be positive, Eq. (11-295) leads to 
dy < poe = 2.618 (11-296) 
From Eq. (11-292), 
8&1 < 2.618 (11-297) 


It is interesting to note that applying the Routh—Hurwitz criterion to the charac- 
teristic equation of Eq. (11-289) shows that the closed-loop system with feedback from 
x1 is stable for g: < 6. However, for the optimal partial state feedback control, g, 
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must be less than or equal to 2.618. The difference between the two values of g; is the 
margin of relative stability. 
The weighting matrix is given by 


di did, dd; 
Q=DD=/did, d} dd; (11-298) 
did; dod; d} 
whose elements have to satisfy Eqs. (11-292) through (11-294). 
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11.1. 


11.2. 


PROBLEMS 


Prove that the “integral of t?e2(t) criterion,” 


= [7202 
J J; 20200) at 


can be expressed as 


jo 
72 ay i ie F(s)F(—s) ds 


where F(s) = dE(s)/ds. 
A unity-feedback control system is shown in Fig. P11-2. 


K 


Figure P11-2. 


(a) Determine the integral square error (ISE), 
J= f ~ et) dt 


when K = 10, r(t) = u,(t) (unit step input), and a = 2. 


(b) Find the value of a as a function of K so that the ISE is minimized, when 
r(t) = u,(t), Determine the damping ratio of the optimal system. 
(c) If K is variable but a is held constant, find the optimal value of K so that 


the ISE is a minimum. 


(d) Repeat part (a) when the input is a unit ramp function, r(t) = tu,(t). 


11.3. The transfer function of a linear process is 
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Determine the optimal closed-loop transfer function C(s)/R(s) such that 


J, = , [r(t) — c(@)}? dt = minimum 


_ [> fauay? 

0 

The reference input r(f) is a unit step function, 
11.4. A linear process is described by 

xX, = X2 

Xo =u 
where x, and x2 are state variables and wu is the control. It is desired to mini- 
mize the quadratic performance index 

J=4[" [er — x0? + wat 


where xz = constant. Determine the optimal control as a function of x, x2, 
and xz, by means of the integral-square-error design. Draw a block diagram 
for the completely designed system. 


11.5. For thecontrol system shown in Fig. P11-5, the input r(¢) is a unit step function. 


Figure P11-5. 


(a) Determine K, and K, so that the integral square error J, is minimized, 
subject to J, < 1; 


5 a i : ed I= ih d(t) dt 


The noise signal n(t) is assumed to be zero. 

(b) If r(t) = 0, and the values of K, and K, are as determined in part (a), 
find the maximum strength of the impulse disturbance x(t) = NO6(t) that 
can be applied to the system such that J, < 1. 

(c) Repeat part (a) with the following design criteria: 


JIe<1 . = minimum 


(d) Repeat part (b), and find the maximum strength of the impulse disturbance 
N such that J, is less than or equal to the minimum value found in (c). 
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11.6. The control system shown in Fig. P11-6 has two free parameters in K, and 
K,. Determine the values of K, and K, by parameter optimization such that 


je f i e*(t) dt = minimum 
i= . u(t) dt < 2.5 


The reference input is a step function with an amplitude of 0.5. 


c(t) 


Figure P11-6. 


11.7. Consider the linear process 
X(t) = Ax(t) + Bu(t) 
c(t) = Dx(t) 


1 0 1 
a= | B=| | D={2 —IJJ 
0 0 1 


Design a state observer so that x(t) — x.(t) will decay as fast as e~!°'. Find the 
characteristic equation of the observer and the feedback matrix G,. Write the 
state equation of the observer in matrix form. 


where 


11.8. A linear time-invariant process is described by the state equation 
X(t) = —0.5x(t) + u(t) 


with the initial state x(t9) = x9. Find the optimal control u°(t) that minimizes 
the performance index 


J=$[" xt + wr] at 
fo 
where tp = O and tf; = 1 sec. 
11.9. Solve Problem 11.8 with t, = oo, 
11.10. Consider the linear process 
X(t) = 0.5x(t) + u(t) 


It is desired to minimize the performance index 


T 
= why 2 ~ty2 
J Jae *x2 +. e~fy2) dt 
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Show that the optimal control is given by 


: 11 — ee? 
WO) =~ 3 Eger O 


11.11. A second-order process is described by the state equations 
X1(t) = x2(t) 
X2(t) = u(t) 
Find the optimal state-feedback control that minimizes 
J=A [Gt + Qeixe + xd + 0?) dt 


Draw a block diagram for the closed-loop system. Find the damping ratio of 
the system. 


11.12. Consider the linear time-invariant process 
x(t) = Ax(t) + Bu(t) 


where 
0 1 0 0 
A=|0 01 B=|/ 0 
4 -4 1 1 


It is desired to find the feedback gain matrix G =[g, 0 g3] such that the 
performance index 


f= ‘a [x’(NOx(t) + u2(0)] dt = minimum 


Formulate the problem using the method described by Eqs. (11-284) through 
(11-288). Find the bounds on g, and g; such that solutions to the optimal 
linear regulator problem with the specific partial state feedback exist. 


APPENDIX A 


Frequency-Domain Plots 


Consider that G(s)H(s) is the loop transfer function of a feedback control 
system. The sinusoidal steady-state transfer function is obtained by setting 
5 = j@ in G(s)H(s). In control systems studies, frequency-domain plots of the 
open-loop transfer function G(j@)H( ja) are made for the purpose of analysis of 
the performance of the closed-loop control system. 

The function G( jo) is generally a complex function of the frequency wand 
can be written 


G(ja) = | G(ja) | /Gjo) (A-1) 


where | G( ja) | denotes the magnitude of G( ja) and /G( ja) is the phase of G(ja). 

The following forms of frequency-domain plots of G(jw) [or of G( ja) H( jo)) 
versus q@ are most useful in the analysis and design of feedback control systems 
in the frequency domain. 


1. Polar plot: a plot of the magnitude versus phase in the polar coor- 
dinates as q@ is varied from zero to infinity. 

2. Bode plot (corner plot): a plot of the magnitude in decibels versus 
@ (or log,, @) in the semilog (or rectangular) coordinates. 

3. Magnitude-versus-phase plot: a plot of the magnitude in decibels 
versus the phase on rectangular coordinates with w as a variable 
parameter on the curve. 


These various plots are described in the following sections. 
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A.1 Polar Plots of Transfer Functions 


The polar plot of a transfer function G(s) is a plot of the magnitude of G(ja) 
versus the phase of G(jq@) on the polar coordinates, as @ is varied from zero to 
infinity. From a mathematica] viewpoint, the process may be regarded as a map- 
ping of the positive half of the imaginary axis of the s-plane onto the plane of the 
function G(j@). A simple example of this mapping is shown in Fig. A-1. For any 
frequency @ = @;, the magnitude and phase of G(j@,) are represented by a 
phasor that has the corresponding magnitude and phase angle in the G(jw)- 


jImG 
G(jw)-piane 


Fig. A-1. Polar plot shown as a mapping of the positive half of the j@ axis 
in the s-plane onto the G(jw)-plane. 
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plane. In measuring the phase, counterclockwise is referred to as positive, and 
clockwise as negative. 

To illustrate the construction of the polar plot of a transfer function, con- 
sider the function 


1 
G(s) = Tah (A-2) 
where T is a positive constant. 
Putting s = j@, we have 
; 1 

G(jo) = 1+ jot (A-3) 

In terms of magnitude and phase, the last expression is written 

: 1 

= = /—tan"! A-4 
G(jo) Tie oT L an”! @T (A-4) 


When q is zero, the magnitude of G(jq@) is unity, and the phase of G(jq) is 
at 0°. Thus, at @ = 0, G(ja) is represented by a phasor of unit length directed in 
the 0° direction. As @ increases, the magnitude of G(j@) decreases, and the phase 
becomes more negative. As @ increases, the length of the phasor in the polar 
coordinates decreases, and the phasor rotates in the clockwise (negative) direc- 
tion. When @ approaches infinity, the magnitude of G(jm) becomes zero, and 
the phase reaches —90°. This is often represented by a phasor with an infinitesi- 
mally small length directed along the —90° axis in the G(jw)-plane. By sub- 
stituting other finite values of @ into Eq. (A-4), the exact plot of G(j@) turns out 
to be a semicircle, as shown in Fig. A-2. 

As a second illustrative example, consider the transfer function 


1 + joT: Z 
G( joo) = ser (A-5) 


where 7, and T, are positive constants. Equation (A-5) is written 


jImG G(jw)-plane 


——> ReG 
tan-lwT 


Phasor of G(jw) 


1 


, 1+ w272 


Fig. A-2. Polar plot of Gj@) = 1/(1 + j@T). 
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GCay= aoe 1 pion on jtan-) @T, — tan-! oT (A-6) 
The polar plot of G(ja), in this case, depends upon the relative magnitudes of 
T, and T,. If T, is greater than 7, the magnitude of G( ja) is always greater than 
unity as @ is varied from zero to infinity, and the phase of G( ja) is always posi- 
tive. If 7, is less than 7,, the magnitude of G( ja) is always less than unity, and 
the phase is always negative. The polar plots of G(jm@) of Eq. (A-6) that cor- 
respond to the two above-mentioned conditions are shown in Fig. A-3. 


jimG 


G(jw)-plane 


(T, <T,) 
Fig. A-3. Polar plots of G(jw) = (1 + j@7T2)/U + jwT;). 


It is apparent that the accurate plotting of the polar plot of a transfer func- 
tion is generally a tedious process, especially if the transfer function is of high 
order. In practice, a digital computer can be used to generate the data, or even 
the final figure of the polar plot, for a wide class of transfer functions. However, 
from the analytical standpoint, it is essential that the engineer be completely 
familiar with the properties of the polar plot, so that the computer data may be 
properly interpreted. In some cases, such as in the Nyquist stability study, only 
the general shape of the polar plot of G(ja@)H(ja) is needed, and often a rough 
sketch of the polar plot is quite adequate for the specific objective. In general, 
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the sketching of the polar plot is facilitated by the following information: 

1. The behavior of the magnitude and the phase at @ =- 0 and at m@ = co. 

2. The points of intersections of the polar plot with the real and imaginary 
axes, and the values of q@ at these intersections. 

The general shape of the polar plot may be determined once we have infor- 
mation on the two items listed above. 


ExampLe A-1 Consider that it is desired to make a rough sketch of the polar plot 
of the transfer function 

10 

G(s) = s(s + 1) 

Substituting s = j@ in Eq. (A-7), the magnitude and phase of G(j@) at @ = 0 and 

@ = © are computed as follows: 


(A-7) 


lim |G(j@)| = lim 22 = 0 (A-8) 
a0 a9 @ 

lim /G(j@) = lim [12 = —90° (A-9) 
ye gee 

; 10 

lim | G(je)| = lim mie (A-10) 
lim [G(j@) = lim lle: = ~180° (A-11) 
@e0 00 (j@)* 


Thus the properties of the polar plot of G(j@) at @ = 0 and @ = care ascertained. 
Next, we determine the intersections, if any, of the polar plot with the two axes of the 
G(j@)-plane. 
If the polar plot of G(jq@) intersects the real axis, at the point of intersection, the 
imaginary part of G(j@) is zero; that is, 
Im[G(j@)] = 0 (A-12) 
In order to express G(j@) as 
G(j@) = Re[Gj@)] + j Im[G(ja@)] (A-13) 
we must rationalize G(j@) by multiplying its numerator and denominator by the com- 
plex conjugate of its denominator. Therefore, G(j@) is written 


~jo\(—j —10@2 
G(jo) = 10(—j@)(—jo + 1) 100? 10@ 


jogo FI)(-joy—jo Fh) at + a Jarre: ‘A14) 
which gives 
~10 
IMG = sare y (A-15) 
and 
Re[Gio)] = as (A-16) 


When we set Im[G(j@)] to zero, we get @ = ~, meaning that the only intersect 
that the G(j@) plot has with the real axis of the plane is at the origin. 

Similarly, the intersection of the polar plot of G(j@) with the imaginary axis is 
found by setting Re[G(j@)] of Eq. (A-16) to zero. The only real solution for @ is also 
@ = co, which corresponds to the origin of the G(j@)-plane. The conclusion is that the 
polar plot of G(jq@) does not intersect any one of the two axes at any finite nonzero 
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jImG 


G(jou)-plane 


ReG 


Fig. A-4. Sketch of the polar plot of G(s) = 10/[s(s + 1)]. 


frequency. Based upon this information, as well as knowledge on the angles of G(jw) 
at @ =0 and @ =o, the polar plot of G(jq@) is easily sketched, as shown in Fig. A-4. 


EXAMPLE A-2 —Giiven the transfer function 


10 
s(s + 1)(s + 2) 


it is desired to make a rough sketch of the polar plot of G( j@). The following calcula- 
tions are made for the properties of the magnitude and phase of G(j@) at @ = 0 and 
@=oo: 


G(s) = (A-17) 


lim|G(j@)| = lim = co (A-18) 
a0 a0 @ 
5 a 
jim [G(j@) = lim [jo = —90' (A-19) 
10 
Tim | G( jo)| = jim —3=0 (A-20) 
lim [G(j@) = lim lGap oy = —270° (A-21) 


To find the intersections of the G(j@) curve on the real and the imaginary axes of the 
G(j@)-plane, we rationalize G(j@) to give 


~ joGo + )Ge +2(—jo\(—jo FI—ja +2 (4-22) 
After simplification, Eq. (A-22) is written 
‘ poe 2 : — @ 
GUja) = 300 j10@(2 — @?) (A-23) 
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We set 

Re[GO)] = a5r-G aap = 0 (A-24) 
and 

ImiGGay = = A OD _ 26 (A-25) 


Equation (A-24) is satisfied when 
oO= 0 


which means that the G(j@) plot intersects the imaginary axis only at the origin. Equa- 
tion (A-25) is satisfied when 
@? =2 


which gives the intersection on the real axis of the G(jq@)-plane when @ = +,/2 
rad/sec. Substituting @ = ./2 into Eq. (A-23) gives the point of intersection at 


Gj./2) = —3 (A-26) 


The result of @ = —./2 rad/sec has no physical meaning, but mathematically 
‘it simply represents a mapping point on the negative j@ axis of the s-plane. In general, 
if G(s) is a rational function of s (a quotient of two polynomials of s), the polar plot 
of G(j@) for negative values of @ is the mirror image of that for positive @, with the 
mirror placed on the real axis of the G(j@)-plane. 

With the information collected above, it is now possible to make a sketch of the 
polar plot for the transfer function in Eq. (A-17), and the sketch is shown in Fig. A-5. 

Although the method of obtaining the rough sketch of the polar plot of a transfer 
function as described above is quite straightforward, in general, for complex transfer 


jImG 


G(jw)-plane 


w = V2 rad/sec 


Fig. A-S. Sketch of the polar plot of G(s) = 10/{s(s + 1)(s + 2)}. 
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functions that may have multiple crossings on the real and imaginary axes in the trans- 
fer function plane, the algebraic manipulation may again be quite involved. Further- 
more, the polar plot is basically a tool for analysis; it is somewhat awkward for design 
purposes. We shall show in the next section that approximate information on the polar 
plot can always be obtained from the Bode plot, which is usually sketched without any 
computations. Thus, for more complex transfer functions, other than using the digital 
computer, sketches of the polar plots are preferably obtained with the help of the 
Bode plots. 


A.2 Bode Plot (Corner Plot) of a Transfer Function 


The discussions in the last section show that the polar plot portrays a function 
G(jq) in the polar coordinates in terms of its magnitude and phase as functions 
of w. The Bode plot, on the other hand, contains two graphs, one with the 
magnitude of G( ja) plotted in decibels versus log @ or w, and the other with the 
phase of G(ja) in degrees as a function of log w or w. The Bode plot is also 
known sometimes as the corner plot or the logarithmic plot of G(j@). The name, 
corner plot, is used since the Bode plot is basically an approximation method in 
that the magnitude of G( ja) in decibles as a function of @ is approximated by 
straight-line segments. 

In simple terms, the Bode plot has the following unique characteristics: 


1. Since the magnitude of G(j@) in the Bode plot is expressed in deci- 
bels, the product and division factors in G( ja) become additions and 
subtractions, respectively. The phase relations are also added and 
subtracted from each other in a natural way. 

2. The magnitude plot of the Bode plots of most G( ja) functions en- 
countered in control systems may be approximated by straight-line 
segments. This makes the construction of the Bode plot very simple. 


Since the corner plot is relatively easy to construct, and usually without 
point-by-point plotting, it may be used to generate data necessary for the other 
frequency-domain plots, such as the polar plot, or the magnitude-versus-phase 
plot, which is discussed later in this chapter. 

In general, we may represent the open-loop transfer function of a feedback 
control system without pure time delay by 


_ KG + 2s + 22) +++ (5 + Zn) - 
Gs) = Si(s + pi)(s + pr) +++ (8 + Py) ae 


where K is a real constant and the zs and the ps may be real or complex numbers. 
As an alternative, the open-loop transfer function is written 


G(s) = KUL Tis + Ts) +++ (1 + Ts) 
s(l + T,s)(1 + T,s) «+: + T,s) 
where X is a real constant, and the Ts may be real or complex numbers. 


In Chapter 8, Eq. (A-27) is the preferred form for root loci construction. 
However, for Bode plots, the transfer function should first be written in the form 


(A-28) 
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of Eq. (A-28). Since practically all the terms in Eq. (A-28) are of the same form, 
without loss of generality, we can use the following transfer function to illus- 
trate the construction of the Bode diagram: 
K(1 + T,s)(1 + T,s) 
G(s) = = ESS A- 

= + TN + Pe — w) 2) 
where K, 7,, T,, T., ¢, and yz are real coefficients. It is assumed that the second- 
order polynomial, | + 2¢4 — u?, uw = w/w,, has two complex-conjugate zeros. 

The magnitude of G( ja) in decibels is obtained by multiplying the logarithm 
to the base 10 of | G(ja)| by 20; we have 

| G( jo) lon = 20 logy. | G(jon)| = 20 log: | K | + 20 logy |1 + joTs| 

+ 20 logyo|1 + joT,| — 20 logis | jo| (A-30) 
— 20 logio|1 + jwT,| — 20 logig|1 4 j2Cu — pw} 
The phase of G(jq) is written 
/GUi@) = /K + [1 + joT, + /1 + joT, — /jo 
[+ joT, — [1 + ju ~ pw? 

In general, the function G(j@) may be of higher order than that of Eq. 
(A-29) and have many more factored terms. However, Eqs. (A-30) and (A-31) 
indicate that additional terms in G(j@) would simply produce more’ similar 
terms in the magnitude and phase expressions, so that the basic method of 
construction of the Bode plot would be the same. We have also indicated that, 
in general, G(j@) may contain just four simple types of factors: 


(A-31) 


1. Constant factor K 

2. Poles or zeros at the origin (jm)*? 

3. Poles or zeros not at @ = 0 (+ jw@T)*4 

4. Complex poles or zeros C+ f26u — p?)*" 


where p, q, and r are positive integers. 

Equations (A-30) and (A-31) verify one of the unique characteristics of the 
Bode plot in that each of the four types of factors listed may be considered as a 
separate plot; the individual plots are then added or subtracted accordingly to 
yield the total magnitude in decibels and phase plot of G( ja). The curves may be 
done on semilog graph paper or linear rectangular coordinate graph paper, 
depending on whether q@ or log,, @ is used as the abscissa. 

We shall now investigate the sketching of the Bode plot of the different 
types of factors. 


Constant Term, K 


Since 
Kay = 20 log,, K = constant (A-32) 

and 
[K = 


( K>0 aes 


180° K<0 
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Fig. A-6. Bode plot of constant K. 


the Bode plot of the constant factor K is shown in Fig. A-6 in semilog coordi- 
nates. 


Poles and Zeros at the Origin, (jw)*? 
The magnitude of (j@)*? in decibels is given by 
20 logs |(j@)*?| = +20p log, w dB (A-34) 


for @ > 0. The last expression for a given p represents the equation of a straight 
line in either semilog or rectangular coordinates. The slopes of these straight 
lines may be determined by taking the derivative of Eq. (A-34) with respect to 
log,, @; that is, 

Toe3 (+20p log, @) = +20» dB (A-35) 
These lines all pass through the 0-dB point at @ = 1. Thus a unit change in 
log,) w will correspond to a change of +20p dB in magnitude. Furthermore, a 
unit change in Jog, @ in the rectangular coordinates is equivalent to | decade of 
variation in @, that is, from 1 to 10, 10 to 100, and so on, in the semilog coordi- 
nates. Thus the slopes of the straight lines described by Eq. (A-34) are said to 
be +20p dB/decade of frequency. 

Instead of using decades, sometimes the unit octave is used to represent the 
separation of two frequencies. The frequencies @, and q@, are separated by an 
octave if w./a@, = 2. The number of decades between any two frequencies @, 
and q@, is given by 


— 10810 (@2/a1) _ 2 a 
number of decades — jog 107 logy (2) (A-36) 


Similarly, the number of octaves between w, and @, is 


_ login (@2/@;) (22) a 
number of octaves = = Ing SOL log; Di (A-37) 


Thus, the relation between octaves and decades is given by 


1 


number of octaves = 0301 


decades (A-38) 
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Substituting Eq. (A-38) into Eq. (A-35), we have 
+20p dB/decade = +20p x 0.301 ~ +6p dB/octave (A-39) 


For a transfer function G( j@) that has a simple pole at s =: 0, the magnitude 
of G( jaa) is a straight line with a slope of —20 dB/decade, and passes through the 
0-dB axis at@ = 1. 

The phase of (j@)*? is written 


/(i@)*? = +p x 90° (A-40) 


The magnitude and phase curves of the function (jmw)*” are sketched as 
shown in Fig. A-7 for several values of p. 
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Fig. A-7. Bode plots of (jw)*?. 
Simple Zero (1 + j@T) 


Let 
G( jo) = 14+ joT (A-41) 
where 7 is a real constant. The magnitude of G(ja) in decibels is written 
|G( joo) lan = 20 log yo | G( jo) | = 20 login 1 + wT? (A-42) 
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To obtain asymptotic approximations to the magnitude of G(j@), we consider 
both very large and very small values of w. At very low frequencies, wT < 1, 
Eq. (A-42) is approximated by 


|G( joo) lan = 20 logy | G( jo) | ~ 20 log,, 1 = 0dB (A-43) 
since qT? is neglected when compared with |. 
At very high frequencies, wT >> 1, we may approximate 1 + @?T? by 
w’T*; then Eq. (A-42) becomes 
|G(joo) las = 20 logo | G(jaa)| = 20 logy) ./@*T? 
= 20 logy) oT 


Equation (A-44) respresents a straight line with a slope of +20 dB/decade of 
frequency. The intersect of this line with the 0-dB axis is found by equating Eq. 
(A-44) to zero, which gives 


(A-44) 


This frequency is also the intersect of the high-frequency approximate plot and 
the low-frequency approximate plot which is the 0-dB line as given by Eq. (A-43). 
The frequency given by Eq. (A-45) is also known as the corner Srequency of the 
Bode plot of the transfer function in Eq. (A-41), since the approximate magni- 
tude plot forms the shape of a corner at that frequency, as shown in Fig. A-8. The 
actual magnitude curve for G( ja) of Eq. (A-41) is a smooth curve, and deviates 
only slightly from the straight-line approximation. The actual values for the 
magnitude of the function 1 + j@T as functions of wT are tabulated in Table A-1. 
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Fig. A-8. Magnitude versus frequency of the Bode Plots of G(s) = 1 + Ts 
and G(s) = 1/(1 + 7s). 
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App. A 
Table A-1 
a ss Se eee 
oT logi9 @T {1 + ja@T| {\L+j@T! A+ joT 
(dB) 
0.01 —2 1 0 0.5° 
0.1 —1 1.04 0.043 §.7° 
0.5 —0.3 1.12 1 26.6° 
0.76 --0.12 1,26 2 37.4° 
1.0 0 1.41 3 45.0° 
1.31 0.117 1.65 4.3 52.7° 
1.73 0.238 2.0 6.0 60.0° 
2.0 0.3 2.23 7.0 63.4° 
5.0 0.7 5.1 14,2 78.7° 
10.0 1.0 10.4 20.3 84,3° 
Table A-2 
Straight-Line 
Approximation of 
@T {1 + joT} {1 + joT| Error 
(dB) (dB) (dB) 
0.1 (1 decade 0.043 0 0.043 
below corner 
frequency) 
0.5 (1 octave 1.0 0 1 
below corner 
frequency) 
0.76 2 0 2 
1.0 (at the corner 3 0 3 
frequency) 
1.31 4.3 2.3 2 
2.0 (1 octave 7 6 1 
above corner 
frequency) 
10 (1 decade 20.043 20 0.043 
above corner 
frequency) 


Table A-2 gives a comparison of the actual values with the straight-line approxi- 
mations at some significant frequencies. 

The error between the actual magnitude curve and the straight-line asymp- 
totes is symmetrical with respect to the corner frequency 1/7. Furthermore, 
it is useful to remember that the error is 3 dB at the corner frequency, and | dB 
at 1 octave above (2/T) and 1 octave below (0.5/7) the corner frequency. At 1 
decade above and below the corner frequency, the error is dropped to approxi- 
mately 0.3 dB. From these facts, the procedure in obtaining the magnitude curve 
of the plot of the first-order factor (1 + j@7) is outlined as follows: 
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1. Locate the corner frequency wm = 1/T. 

2. Draw the 20 dB/decade (or 6 dB/octave) line and the horizontal 
line at 0 dB, with the two lines interesecting at @ = 1/T. 

3. If necessary, the actual magnitude curve is obtained by locating the 
points given in Table A-1. 


Usually, a smooth curve can be sketched simply by locating the 3-dB 
point at the corner frequency and the 1-dB points at | octave above and below 
the corner frequency. 

The phase of G( jw) = 1 + j@T is written as 

(Gio) = tan-! wT (A-46) 
Similar to the magnitude curve, a straight-line approximation can be made for 
the phase curve. Since the phase of G( ja) varies from 0° to 90° we may draw a 
line from 0° at 1 decade below the corner frequency to +90° at 1 decade above 
the corner frequency. As shown in Fig. A-9, the maximum deviation of the 


straight-line approximation from the actual curve is less than 6°. Table A-1 
gives the values of /1 + jwT versus wT. 


Arg G(s) 


Fig. A-9. Phase versus frequency of the Bode plots of G(s) = 1 + Ts and 
G(s) = 1/(1 + Ts). 


Simple Pole, 1/(1 +- j@T) 
When 


G(jo) = (A-47) 


1 
I+ joT 
the magnitude, |G(ja@)| in decibels is given by the negative of the right side of 
Eq. (A-42), and the phase /G(jq@) is the negative of the angle in Eq. (A-46). 
Therefore, it is simple to extend all the analysis for the case of the simple zero 
to the Bode plot of Eq. (A-47). We can write 


oT <1  — |G(jo) las ~ 0 dB (A-48) 
@T>1 — |G(jo) las = —20 log, wT (A-49) 


Thus the corner frequency of the Bode plot of Eq. (A-47) is still at @ = 1/T. 
At high frequencies, the slope of the straight-line approximation is +20 dB/ 
decade. The phase of G(jq@) is 0° when wm = 0 and —90° when w approaches 
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infinity. The magnitude and the phase of the Bode of Eq. (A-47) are shown in 
Figs. A-8 and A-9, respectively. The data in Tables A-1 and A-2 are still useful 
for the simple pole case, if appropriate sign changes are made to the numbers. 
For instance, at the corner frequency, the error between the straight-line 
approximation and the actual magnitude curve is —3 dB. 


Quadratic Poles and Zeros 


Now consider the second-order transfer function 


GG OF 
Oe + Llons + wi 
1 
~ 1+ (2f/e@,)s + (/or)s? 

We are interested only in the cases when { < 1, since otherwise, G(s) would 
have two unequal real poles, and the Bode plot can be determined by consider- 
ing G(s) as the product of two transfer functions each having a simple pole. 

Letting s = jw, Eq. (A-50) becomes 


(A-50) 


G(jo) = (A-51) 


1 
[1 — (w/a,)?] + j20(o/,) 
The magnitude of G(jq@) in decibels is 


20 log, |GLjo)| = —20 logy, [A = (2) f a 4(2) (A-52) 


At very low frequencies, w/w, < 1; Eq. (A-52) may be written as 
|GGe@) lan = 20 log, |G( ja) | = —20 log,, 1 = 0dB (A-53) 
Thus the low-frequency asymptote of the magnitude plot of Eq. (A-50) is a 
straight line that lies on the 0-dB axis of the Bode plot coordinates. 


At very high frequencies, w/a, >> 1; the magnitude in decibels of G(j@) in 
Eq. (A-50) becomes 


i 
|G( joo) lan = 20 1089 | GC eo) | = —20 logs» 4/2) 
. (A-54) 
= —40 log, (2) dB 


This equation represents the equation of a straight line with a slope of 
— 40 dB/decade in the Bode plot coordinates, The intersection of the two asymp- 
totes is found by equating Eq. (A-53) with Eq. (A-54), yielding 


—40 log: (2) =0dB (A-55) 
and from which we get 
oO= QO, (A-56) 


Thus the frequency, @ = @,, is considered to be the corner frequency of the 

second-order transfer function of Eq. (A-50), with the condition that € < 1. 
The actual magnitude plot of G(jw) in this case may differ strikingly 

from the asymptotic lines. The reason for this is that the amplitude and phase 
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curves of the G( ja) of Eq. (A-50) depend not only on the corner frequency @,, 
but also on the damping ratio €. The actual and the asymptotic magnitude plots 
of G( ja) are shown in Fig. A-10 for several values of ¢. The errors between the 
two sets of curves are shown in Fig. A-11 for the same set of (s. The standard 


IG(jw)| dB 


0.01 0.1 1.0 10 100 


u= w/Wp 


Fig. A-10. Magnitude versus frequency of Bode plot of G(s) = 1/U 
+ 26(s/con) + (s/e)?]. 


\G(jw)| dB 


Fig. A-11. Error in magnitude versus frequency of Bode plot of G(s) = 
TULL + 26(s/aq) + (5/@n)?). 
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procedure of constructing the magnitude portion of the Bode plot of a second- 
order transfer function of the form of Eq. (A-50) is to first locate the corner 
frequency w,, then sketch the asymptotic lines; the actual curve is obtained by 
making corrections to the asymptotes by using either the error curves of Fig. 
A-11 or the curves in Fig. A-10 for the corresponding ¢. 

The phase of G( ja) is given by 


a) 0 (2) tas 


; O, 
and is plotted as shown in Fig. A-12 for various values of C. 


0° 
— 45° 
a 
> -90 
Q 
2 
< — 135° 
— 180° 
0.01 0.1 1.0 10 100 
= w/w, 


Fig. A-12. Phase versus frequency of Bode plot of G(s) = 1/[l ~- 20(s/a,) 
+ (s/@n)?). 


The analysis of the Bode plot of the second-order transfer function of 
Eq. (A-50) may be applied to a second-order transfer function with two complex 
zeros. If 


G(s) =14 fs cS ars (A-58) 


the Bode plot of G( ja) may be obtained by inverting the curves of Figs. A-10, 
A-11, and A-12. 


EXAMPLE A-3__ As an illustrative example of the Bode plot of a transfer function, let 
us consider 
10(s + 10) 
s(s + 2)(5 + 5) 
The first step is to express the transfer function in the form of Eq. (A-28) and set 5 = 
jo. Thus Eq. (A-59) becomes 


G(j@) = 


G(s) = (A-59) 


101 + j0.1@) 


J@U + j0.5@)(1 ++ 70.20) em) 


This equation shows that G(jw) has corner frequencies at w = 10, 2, and 5 
rad/sec. The pole at the origin gives a magnitude curve that is a straight line with a 
slope of —20 dB/decade and passing through the w = 1 rad/sec point on the @ axis at 
0 dB. The total Bode plots of the magnitude and phase of G(j@) are obtained by 
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Fig. A-13. Bode plot of G(s) = [10(s + 10)]/[s(s + 2)(s + 5)]. 


adding the component curves together, point by point, as shown in Fig. A-13. The 
actual magnitude curve may be obtained by considering the errors of the asymptotic 
curves at the significant frequencies. However, in practice, the accuracy of the asym- 
ptotic lines is deemed adequate for transfer functions with only real poles and zeros. 


A.3. Magnitude-Versus-Phase Plot 


The magnitude-versus-phase diagram is a plot of the magnitude of the transfer 
function in decibels versus its phase in degrees, with @ as a parameter on the 
curve. One of the most important applications of this plot is that it can be super- 
posed on the Nichols chart (see Chapter 9) to give information on the relative 
stability and the frequency response of the closed-loop system. When the gain 
factor K of the transfer function is varied, the plot is simply raised or lowered 
vertically according to the value of K in decibels. However, the unique property 
of adding the individual plots for cascaded terms in the Bode plot does not 
carry over to this case. Thus the amount of work involved in obtaining the 
magnitude-versus-phase plot is equivalent to that of the polar plot, unless a 
digital computer is used to generate the data. Usually, the magnitude-versus- 
phase plots are obtained by first making the Bode plot, and then transferring the 
data to the decibel-versus-phase coordinates. 

As an illustrative example, the Bode plot, the polar plot, and the magnitude- 
versus-phase plot of the function 


10(s + 10) 


8) = 355 G+ 5) 


(A-61) 
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Fig. A-14, G(s) = [10(s + 10)]/[s(s + 2)(s + 5)]. (a) Polar plot. (b) Bode 
diagram. (c) Magnitude-versus-phase plot. 


are sketched as shown in Fig. A-14. The Bode plot shown in Fig. A-14(a) is appar- 
ently the easiest one to sketch. The others are obtained by transferring the data 
from the Bode plot to the proper coordinates. 

The relationships among these three plots are easily established by compar- 
ing the curves in Fig. A-14 without the need of detailed explanation. However, 
for the purpose of analysis and design, it is convenient to define the following 
terms: 


Gain-crossover frequency. This is the frequency at which the magnitude of 
the transfer function G(jq) is unity. In logarithmic scale, this corresponds to 
0 dB. The following interpretations are made with respect to the three types of 
plots: 

Polar Plot. The gain-crossover point (or points) is where | G(j@)| = 1 [Fig. 
A-14(a)]. 
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Bode Plot. The gain-crossover point (or points) is where the magnitude 
curve of G(ja) crosses the 0-dB axis [Fig. A-14(b)]. 

Magnitude-Versus-Phase Plot. The gain-crossover point (or points) is where 
the G( jw) plot crosses the 0-dB axis [Fig. A-14(c)]. 


Phase-crossover frequency. This is the frequency at which the phase of 
G( ja) is 180°. 

Polar Plot. The phase-crossover point (or points) is where the phase of G( ja) 
is 180°, or where the G( ja) plot crosses the negative real axis [Fig. A-14(a)]. 

Boge Plot. The phase-crossover point (or points) is where the phase curve 
crosses the 180° axis [Fig. A-14(b)}. 

Magnitude-Versus-Phase Curve. The phase-crossover point (or points) is where 
the G( ja) plot interesects the 180° axis [Fig. A-14(c)]. 
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Laplace Transform Table 
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t” (n = positive integer) 


euat 


e7at — ev bt 


b-—a 


On On cane Tis 
5? + 20S F On? vie amt sin nV 1 — Ct 
woe ee a) pn tg-t. T: 
G+ sTy Tn — i) 
Toone /T Mn etext sin (Wp 1 — Ct — ) 
ee. 1 — 20Ton + T2o,? =f — 62) — 26T, — T20,2 T20,2° 
2 zz 
da - Ts)(s + ans + @n ) where $ aes Toom/1 — @ [Fo aye 


646 


1 — Tlon, 


App. B Laplace Transform Table / 647 


Laplace Transform Time Function 
F(s) F(t) 
o, é 
ws ot sin @,t 


T@n -1/T 1 ‘ - 
Dy it Tae?” + poe (@nt — ¢$) 


1 T: 2 2 
Pa aS Dar) where ¢ = tan-! 0,T 


pate ees —Cont of ay yy es 
ea 1+ Fi 7° sin (@av/ 1 — ¢2t — ¢) 
5G? -— 2lo,s + Wp? a 
s(s2 -F 2fca,5 + On) wiete se = tani MITE 
On 
5(s2 + @,2) 1 — coS Wat 
iecches 1~—e/T 
s(i + Ts) 


T2@,,2 a 

1 — 137 to, FTI” 
i. e~ Sent sin (Wn 1 — F2t — o) 

1 — C41 — 20 Tan + T2e0q?) 

where ¢ = tan-! v1 — ¢ + tan-! Toon 1 — $? v1 — 2 

—¢ 1— Tlo, 


On? 
s( - Ts)(s2 + 2Ca0n5 + On?) 


a 6 Bt econ sin (OWT = OF — 6) 


s2(s2 + 2Ca_5 + Wn”) ghee @= oan /1— C2 
= a7 


2¢ T3G0y2 

| and eee en ee | oY 

- On 1 — 2WanT + T 20,2 ex 

Wp? en Cont sin (on/1 — Ct — 6) 


s2(1 + Ts)(s2 + 2fcn8 + Wn?) Be ow — 02)(1 — 20m, T + T 20,2) 


where ¢ = 2 tan-1¥-—" a $? + tann1 Zinn Ow or 


1 t—-2T+(+42NerT 


s2(1 + Ts)? 
1 — 2alo, 20,2 ; 
@,2(1 + as) Ona] 1 7 GeO e~hont sin (@n/ 1 — C24 + $) 
y2 + 2o.s + Ont 
ae a where ¢ = tan! Wav" — 6° vale 


@nA(1 + as : 
one Gy 1 + 47,7 sin (nt + 6) where ¢ = tan! aw, 


648 / Laplace Transform Table App. B 


Laplace Transform Time Function 
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Time Funtion 


f(t) 
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Lagrange’s Multiplier Method 


In control system design it is often desirable to maximize or minimize a 


function /(x,, X2,..., X,) with the constraint g(x,, x.,...,,) = g, (constant). 
Lagrange’s method suggests that the desired value of x,, x,,...,x, can be 
found by maximizing or minimizing the function 

F = f(x1, X25. --s Xn) + Ag(X1, X2,.--5%,) (C-1) 
where 


A = Lagrange’s multiplier 


In general, there may be m constraint equations of the form 


BAX) = Bio i=1,2,...,m (C-2) 
for m <n. The symbol x denotes the vector 
K = [X1, %2,--., Xal! (C-3) 
With m constraint equations in Eq. (C-2) to maximize or minimize f(x), F 
becomes 
F = f(x) + Ai8iX) + Ar82(x) + 26. + Am Bin(X) (C-4) 
where 1,,2,,...,A,, are the Lagrange’s multipliers. 


The procedure of the Lagrange’s method is outlined as follows for the 
single-constraint case: 


1. Form the function 
F = f(x) + Ag(x) (C-5) 


2. Maximize or minimize F with respect to x,,x,,...,x,; that is, 
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simultaneously set 


oe ny ae (C-6) 
These 7 equations give the desired values of x,, i= 1,2,...,”, as 
functions of 2. Let these functions be denoted as 
x, = h(A) i=1,2,...,” (C-7) 
3. Substitute Eq. (C-7) into the constraint equation 
B(%1, X25-- +» Xn) = Bo (C-8) 


Equation (C-8) now gives the value of 2. Substituting this A into Eq. 
(C-7) gives the desired optimal values of x,,i = 1, 2,..., 7. 

4. Substitution of the optimal values of x,, x,,..., x, obtained from 
the last step into f(x) gives the optimal value of f. 


The justification of the Lagrange’s method of adjoining the constraint to 
the function to be minimized is as follows. Let a maximum, minimum, or saddle 
point be described as a stationary point. Then the necessary condition for the 


existence of a stationary point of a differentiable function f(x,, X2,..., X,) is 
that 
Of _ E 
x= (C-9) 


Consider a case with just two parameters, x, and x,; that is, f(,, x2) is to be 
maximized or minimized by choosing the proper values for x, and x,, with the 
constraint that 


g(x1, X2) = g, (constant) (C-10) 
The necessary conditions for a stationary point are 
of of 
i OE GeO (Cll) 


Let us assume that x, and x, are arbitrary functions of a dependent vari- 
able y; that is, fand g can be written as f(x,, x2, y) and g(X;, x2, y), respectively. 
Then, we can form the following equations: 


df _ af dx, af de, 
dy 0x, dy + Ox, a (C-12) 
dg_ dg dx, , 0g dx, (C-13) 


dy Ox, dy * Ox, dy 
The necessary conditions for a stationary point, stated in Eq. (C-11), imply 
that the total derivatives in Eqs. (C-12) and (C-13) must vanish at the stationary 
point. Therefore, 


df = jh az, cs faz, =0 (C-14) 


_ og og _ 
dg = 5% dx, + 9p dx, = 0 (C-15) 
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Let us multiply the right side of Eq. (C-15) by an undetermined parameter 
A and then add the result to Eq. (C-14). We have 


(# ar 2 Fe) a, ae (36 ae age) dx, = 0 (C-16) 


If now A is so chosen that 


of Og _ : 
on + As =0 (C-17) 
of og z 
Gat x, =e (C-18) 
and 
&(X1, X2) = 8 (C-19) 


then the necessary condition of a stationary point of f(x,, x.) is satisfied. Thus 
Eqs. (C-17) and (C-18) imply the maximization or minimization of F = f + dg 
with respect to x, and x,. 
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AC control system, 12, 218 
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feedback control system, 61 
multivariable systems, 62 
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Bridged-T network compensation, 557 


C 


Calculus of variation, 575 

Caley—Hamilton’s theorem, 146 

Canonical form, 119 
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Cascade decomposition, 139 
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Constant damping factor loci, 277 
Constant-damping-ratio loci, 277, 451 
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Damping constant (see Damping 
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Damping factor, 276 
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cascade, 139 
direct, 137 
discrete transfer function, 169 
parallel, 139 
Definite integral, table, 578 
Delay time, 272, 282 
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Error coefficients, 268 
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effect on sensitivity, 8 
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types, 11 
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Force-spring system, 191 
FORTRAN, 132 
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Gain margin, 473, 476 
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604 

Hessian matrix, 584 
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Impulse response, 52, 55 
Impulse response matrix, 55 
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Magnification curves, 465, 468, 469, 
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Magnitude-versus-phase plot, 626, N 
643 
Mass, 190 Natural undamped frequency, 275 
Mass-spring-friction system, 204 Negative definite matrix, 38 
Mathematical modeling of physical Newton’s law of motion, 203 
systems, 187 Nichols chart, 490, 493 
Matrix: Noise signal, 9 
addition, 32 Nonlinear control system, 11, 160, 363 
adjoint of, 31 Nonlinear state equation, 158 
algebra, 32 Nyquist criterion, 322, 330 
associate law, 33 Nyquist path, 340 
column, 28 
commutative law, 33 
conjugate, 31 0) 
definiteness, 38 
definition, 27 Observability, 152, 589 
determinant of, 29 definition, 153, 155 
diagonal, 28 Observer (see State observer) 
diagonalization of, 118 Octave, 635 


distributive law, 35 Open-loop control system, 2 
inverse of, 35 block diagram, 3 
multiplication, 33 Operational amplifier, 246 


nonsingular, 29 


Optimal control, 572 


null, 29 Output controllability, 151 
order of, 28 Output equation, 97 
quadrative form, 37 Output node, 67 

rank of, 36 Output vector, 54, 99 
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singular, 29 
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transpose of, 30 Parameter optimization, 583 
unity, 28 Parseval’s theorem, 575 


Maximum overshoot, 272, 281 
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Mechanical power (see Power) 
Mechanical system elements, 190 
Mechanical systems, 203 
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Partial state feedback, 615 
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Performance index, 273, 509, 572 
Phase-crossover frequency, 476, 645 
Minimum-time problem, 509, 573 Phase-lag compensation, 512, 535 
Modal form transformation, 141 Phase-lead compensation, 512, 515 
Multiloop feedback control system, Phase margin, 473, 477, 478 

356 Phase-variable canonical form, 109, 
Multivariable system, 2, 53 586, 617 


Polar plot, 444, 482, 488, 626, 627 

Poles, definition, 17 

Pole-zero cancellation design, 563 

Popov’s stability criterion, 363 

Positional control system, 284, 298, 
303 

Positional error constant, 264 

Positive definite matrix, 38 

Positive semidefinite matrix, 38 

Potentiometer, 209 

Power, 196 

Principle of argument, 335 

Principle of optimality, 601 
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Quadratic forms, 37 


R 


Ramp input, 261 
Rate feedback (see Tachometer 
feedback) 
RC Phase-lag network, 536 
RC Phase-lead network, 516 
Relative stability, 316, 473, 483 
Relay nonlinearity, 364 
Resonant frequency, 463 
Resonant frequency versus damping 
ratio curve, 466 
Riccati equation, 604 
algebraic, 610 
differential, 604 
solution of, 607, 610 
Riccati gain matrix, 606 
Rise time, 272, 282, 283 
Root contour, 424, 529, 547 
Root loci, 290, 375 
asymptotes, 384, 386 
basic conditions, 376 
breakaway points, 392, 436 
complementary, 376 
complete, 376 
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Root loci (contd.) 
construction, 380 
discrete-data control system, 447 
rules of construction, 411 
time delay systems, 434 
Root locus diagram, 290, 322, 375, 
528 
Rotary-to-linear motion, 195 
Rotational motion, 193 
Routh array, 324 
Routh-Hurwitz criterion, 322 
Routh tabulation (see Routh array) 
Rudder control system, 4 


Sample-and-hold, 162 
Sampled-data control system, 13, 171 
(see also Discrete-data control 
systems) 
Sampler: 
finite-pulsewidth, 40 
ideal, 40 
Sampling duration, 39 
Sampling period, 39 
Saturation nonlinearity, 160, 364, 366 
Sensitivity, 7, 497 
Sensitivity function, 9, 499 
Servoamplifier, 246 
Settling time, 272, 284 
Signal flow graphs, 51, 64, 128 
algebra, 69 
basic properties, 66 
construction of, 71 
definitions, 67 
gain formula, 75 
loop, 69 
path, 68 
Signal-to-noise ratio, 9 
Similarity transformation, 118, 148 
Single-valued function, 16 
Singularity, 17 
Spectral factorization, 577 
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Stability, 8, 316 
absolute, 316 
asymptotic, 317 
definition, 317 
multiloop systems, 356 
nonlinear systems, 363 
relative, 316 
time delay systems, 360 
zero-input, 317 
Stabilizability, 587 
State concept, 95 
State controllability, 112, 145-146 
State diagram, 126, 274 
discrete-data systems, 167 
sampled-data systems, 171 
State equations, 96, 97, 173, 460 
canonical form, 119 
discrete-data systems, 161 
electrical networks, 188 
matrix representation, 99 
State feedback (see State-variable 
feedback) 
State observer, 588 
closed-loop control, 595 
State transition equation, 103, 133, 317 
State transition matrix, 101, 164, 174, 
317 
properties, 102 
significance of, 102 
State-variable feedback, 305 
State variables, 95 
definition, 96 
State vector, 99 
Static friction, 192 
coefficient, 192 
Steady-state error, 260, 262, 510 
Steady-state response, 259 
Step input, 260 
Step motors, 228 
torque curve, 232 
variable-reluctance type, 228 
Sun-Seeker system, 243, 520, 539 
Suppressed-carrier modulated signal, 
211 
Suppressed-carrier modulation, 212 
Synchro, 213 


Synchro control transformer, 213, 215 
Synchro transmitter, 213 
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Tachometer, 219, 246 
Tachometer feedback, 302 
Tension control system, 5, 235 
Time delay systems, 360, 434 
Time-domain analysis, 259 
Time-invariant system, 12 
Time-optimal problem, 509 
Time-varying state equation, 173 
solution, 175 
Time-varying systems, 12, 173 
discrete approximation, 175 
Timing belt, 198, 200 
Torque constant, 221 
Torque-inertia system, 194 
Torsional spring, 194 
Tracking problem, 573 
Transfer function, 51 
decomposition of, 136 
discrete-data systems, 81 
linear systems, 51 
multivariable systems, 62 
Transfer function matrix, 54, 460 
Transient response, 259, 271 
second-order system, 273, 280 
Translational motion, 190 
Transportation lags, 242 
Two-phase induction motor, 225 _ 


U 

Unit step function, 19, 26 

Unit step response, 272, 294, 307, 
470, 471 

Vv 


Vandermonde matrix, 120, 157 
Velocity error constant, 265 


Viscous friction, 192 
coefficient, 192, 199 


Ww 


Weighting function, 55 
Weighting sequence, 82 


Z 


zero-input response, 317 
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zero-input stability, 317 
zero-order hold, 171 (see also 
Sample-and-hold) 

zeros, definition, 17 
z-transfer function, 83 
z-transform, 15, 39 

definition, 41 

final-value theorem, 46 

initial-value theorem, 46 

inverse, 43 

table, 43 

theorems, 45 
z-transform method, 165 
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